Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Parallel processing of the same job

  1. #1
    Join Date
    Aug 2013
    Posts
    24

    Default Parallel processing of the same job

    Hi all,

    Have a question about parallelism.

    I need to import several CSV files into a DB. I have the job running sequentially.

    The idea is to have a job that can be called one time for each entry in a list.
    So i get my list of files in one job, Copy results, and the next step I mark it to run for each row, and in parallel.

    The problem is that run in parallel is ignored, and it runs one for each record, but sequentially.

    ANyone has any experience running the same job several times in parallel?

    Any example I can use?

    Thanks all!

    Daniel

  2. #2
    Join Date
    Aug 2011
    Posts
    360

    Default

    You can use the step JobExecutor in a transformation to execute the job in parallel.

  3. #3
    Join Date
    Aug 2013
    Posts
    24

    Default

    Thanks Mathias..

    Exactly what i did, worked like a charm!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.