Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Read Specific data from text file

  1. #1

    Default Read Specific data from text file

    Hi

    I'm new to DataIntegration part
    I have a text file which is basically system log file,so now i wanted to get specific information from the file
    Since log file will be unstructured format how i should read specific data from file and store in Database tables..
    My output table should be like this
    Date time Cpu Usage Memory usage Errors Error Description
    21/6/2013 3% 20% 1 Error reason
    28/06/2013 9% 66% 10 ,,


    Please help out how to achieve this,and what are the concepts i need to know to do this..
    Please help me out asap

  2. #2
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    Use a text file Input step to load the text file, then apply some filtering/transformations using different steps.
    Or you can load the file in memory and use some Java script to extract the information that you need.

    Finally, use table output step to load your data in a DB.

    Mick

  3. #3

    Default

    Quote Originally Posted by Mick_data View Post
    Use a text file Input step to load the text file, then apply some filtering/transformations using different steps.
    Or you can load the file in memory and use some Java script to extract the information that you need.

    Finally, use table output step to load your data in a DB.

    Mick

    Thanks a lot mick
    From ur answer i have few questions, Does this Text file input Step will be able read specific data and its corresponding value from the file..
    and one more thing is that My file is in unstructured format.so is it possible to get what i wanted to do...
    Last edited by Abhishek Dhavala; 07-01-2013 at 07:40 AM.

  4. #4
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    Yes.
    You should check the wiki:
    http://wiki.pentaho.com/display/EAI/...egration+Steps

    and some examples that are in your installation directory, folder called "samples".

    Don't be afraid to try and test!
    If you keep your source file intact, nothing wrong can happen.

    There are a couple of books available as well, check the sticky post at the top of this forum for more info.

    Mick

  5. #5

    Default

    Thanks a lot mick..

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.