Hitachi Vantara Pentaho Community Forums
Results 1 to 7 of 7

Thread: Parallel steps and Join

  1. #1
    Join Date
    Jul 2011
    Posts
    6

    Default Parallel steps and Join

    I figured out how to enable 2 steps to execute in parallel. However, I can not figure out how to make the next step after the parallel steps to wait and not execute unless the 2 parallel steps have completed successfully.

    This is your typical fork and join scenarios. Thanks for any help or info on how to do this.

  2. #2
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    The solution is nested Jobs.

    Job A
    Job B
    Job C: Parallel Job Wrapper (Consisting of Job X, Job Y, Job Z)
    Job D

    In this setup, Job A occurs, Job B occurs, Job C occurs, which does Job X, Job Y, and Job Z simultaneously, then only when all three are done, does Job D occur.

  3. #3
    Join Date
    Jul 2011
    Posts
    6

    Default

    Quote Originally Posted by gutlez View Post
    The solution is nested Jobs.

    Job A
    Job B
    Job C: Parallel Job Wrapper (Consisting of Job X, Job Y, Job Z)
    Job D

    In this setup, Job A occurs, Job B occurs, Job C occurs, which does Job X, Job Y, and Job Z simultaneously, then only when all three are done, does Job D occur.
    Is it possible to have only 1 job, with parallel steps and a join step within that 1 job only?

  4. #4
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    At current, the only way that I know of is to use a wrapper job.

  5. #5
    Join Date
    Jul 2009
    Posts
    476

    Default

    If you feed the parallel streams to a Blocking Step, where Pass all rows is checked, that should do what you want.

  6. #6
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    Jobs don't have Blocking step

  7. #7
    Join Date
    Jul 2009
    Posts
    476

    Default

    When the original poster said

    Is it possible to have only 1 job, with parallel steps and a join step within that 1 job only?
    I thought he was asking about a transformation, but it's really not clear whether he's talking about parallel steps within a transformation, or running jobs in parallel.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.