Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Fixed File Format Question

  1. #1

    Default Fixed File Format Question

    I have a file that has a fixed format for a row depending on the first 2 characters in the row.

    but in one file, there are several different formats. Is there an easy way to process this sort of file?

    My only idea was to have an input step that reads from the input file, then splits the rows into several files each having only rows with the same format. Once that is done, then I could just define an input file step per newly created file. Is there a way to have a single transform that does this? Can you have an input step that does not try to read from a file until a previous step is totally finished?

    Or is there a better way to parse fixed fields from a line specify a format at a row level?



  2. #2
    Join Date
    Nov 1999

    Default RE: Fixed File Format Question


    Sorry, but like I mentioned before on this forum, this is not yet possible.
    At the moment the workaround is to read the file multiple times and work with filters.

    All the best,


  3. #3

    Default RE: Fixed File Format Question

    But since that is a fixed format, I dont think I can do that. each row has a potentially a different number of characters and is not delimited.

    Is there a step that just does like a join and waits for all previous steps to complete?

  4. #4
    Join Date
    Nov 1999

    Default RE: Fixed File Format Question

    Hi William,

    There is no "order" defined in a transformation. All steps start at once and a step only finishes processing when all previous steps have finished.

    If you really need to have parts of transformation executed one after another, you need to use a temporary (staging) table and split the transformation in 2 or more parts. Sometimes there is just no way around that.


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.