Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Parallel entries in a job

  1. #1
    Join Date
    Apr 2007
    Posts
    2,010

    Default Parallel entries in a job

    Hi,

    If I execute say 3 streams of transforms in parallel in a job, can I then join all the streams back to one, such that it will then only move to the next transform when all 3 streams have finished?

    Or; Should I just put the parallel streams in a sub job and do that.?

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Hi Dan,

    You have to put the parallel work in a sub-job if you want to continue in a serial fashion (actually back-tracking) after the parallel work.

    http://wiki.pentaho.com/display/EAI/...es+in+parallel

    HTH,

    Matt

  3. #3
    Join Date
    Apr 2007
    Posts
    2,010

    Default

    ok I did that just incase. Thanks!

    So I managed to get a job down from 53 minutes to 7 with this approach, nice

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    BTW 4.3 has a "Job Executor" step that can get the job done as well.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.