Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: flow of multiple transformation & "execute for every input row"

  1. #1
    Join Date
    Apr 2007
    Posts
    21

    Default flow of multiple transformation & "execute for every input row"

    Hi, would like to get some clarification on how transformations are launched at the start of a job.

    Suppose i have a Job A and there are 3 transformations in it - t1, t2, t3.
    And I have "execute for every input row" set for t2 and t3.
    And, t1 to t3 are chained with "copy rows to result" and "get rows from results" so that i can pass data between the transformations,

    Is below how the execution flow works?
    When the Job A starts,
    1. t1 will start execution, say, generates 5 rows, send to t2 through "copy rows to result"
    2. t2 will then be executed 5 times since i have set "execute for every input row". Each execution will use 1 of the 5 rows from t1
    3. when t2 finishes 1 of the row, it will call t3
    4. Then t2 will execute another row
    5. t3 will also be called 5 times since i also have "execute for every input row" set for it.


    My experience so far seems to differ from above.
    It seems t2 execute all 5 rows, at the end of 5th row, it will call t3, and will only transfer the last row (not entire 5 rows) to t3.

  2. #2
    Join Date
    Nov 2008
    Posts
    271

    Default

    Hi nicklv,
    put t2 and t3 in a subjob and have it executed for every input row. In this nested job, t3 will be executed for every row coming from t2. It should fit your needs.

    HTH
    Andrea Torre
    twitter: @andtorg

    join the community on ##pentaho - a freenode irc channel

  3. #3
    Join Date
    Apr 2007
    Posts
    21

    Default

    Thanks for the suggestion.
    It works great.

    Cheers,

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.