Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Flat file issue

  1. #1
    Join Date
    Apr 2009
    Posts
    28

    Question Flat file issue

    hi all

    is it possible to extract oltp data into "FLAT FILE" and from flat file to "Staging"

    flow in transformation
    ---------------

    TableInput(OLTP) ---> Flatfile(dump.txt)---> TableOutput(Staging)


    I am getting Struck at Flatfile to TableOutput.

    bcz... we need to define the " get fields " in TableOuput screen how to do that when nothing exist in flatfile before any run of ETL...

    kindly help me out in doing dis.

    Regards
    Narendar

  2. #2

    Default

    _________________|--->Flatfile(dump.txt)
    TableInput(OLTP) ---|
    _________________|---> TableOutput(Staging)


    Or a *job* that does two transformations if you have business process you want to follow to ensure the file is written first before writing the table output

    TableInput->Flatfile
    TableInput->TableOutput

  3. #3
    Join Date
    Apr 2009
    Posts
    28

    Default

    Thanks ford for your reply

    Infact all this process should be run in one ETL go..

    doesnt matter for me even if it requires one transformation or else two..

    but.. OLTP --> flatfile ---> STAGING

    how to do dis...(my issue is if oltp --> staging no problem we can define "get fields" values but if
    OLTP -> flatfile -> STAGING (how i can define "get fields" values with out knowing the fields in flatfile before ETL run)

    hope u got..

    plz solve me the issue..

    Regards
    Narendar

  4. #4
    pstoellberger Guest

    Default

    you need to have a valid file to define the ETL job to use the Get Fields method. otherwise you can just define the fields manually, you don't have to use this button

    why do you dump the data into a file anyway?

    normally i do a Table Input > File ; then run it so i have a file ; then define the File > Table Output .. you don't need to run that.. but you're gonna need a valid file to develop the ETL

    if you just want to have a dump of the loaded data, you can also have a look at the "Serialize to File" and then "De-Serialize File" steps in Kettle. in that step kettle saves additionally the metadata of the columns. and its the fastest way to dump/load data to files

  5. #5
    Join Date
    Apr 2009
    Posts
    28

    Default

    Thanks a lot.. berger , your answer helped me out.


    Regards
    --------
    Narendar

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.