Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Calculation when the job runs in parallel threads

  1. #1
    Join Date
    Feb 2014
    Posts
    29

    Default Calculation when the job runs in parallel threads

    Hi

    I do have a transformation T1 which executes a Job J1 using the job executor step .

    one of the transformation step gives a result set (List of filenames) to job executor and the job downloads them

    Job executor no of copies has been set to 10 to have multiple threads to do the parallel downloading

    The functionality works well.. But i need to have a logic in place to count the total files downloaded by all the threads .. what is the best way to achieve this ? some cases , some threads may not download files (0 rows passed from the input transformation)
    Best,
    Abin

  2. #2
    Join Date
    Sep 2016
    Posts
    18

    Default

    Never used Job executor step but it seems it returns set of fields as Execution results. I think you can figure it out with these fields.


    Thanks
    Ravik

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.