Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: dynamic transformation creation & parallel execution

  1. #1

    Default dynamic transformation creation & parallel execution

    Hello,

    I have a requirement where I will read 'x' (any integer) from a table and based on 'x', I have to create 'x' no. of transformations dynamically. The template for these dynamic transformations will be similar. I ahve to make sure that these transformations execute in parallel as well.

    Please provide some inputs.

    Thanks,
    Sachin

  2. #2
    Join Date
    Aug 2016
    Posts
    11

    Default

    did something similar last month. I'm not on my work computer but basically:

    - job: start -> transform A -> transform B
    - transform A: reads X from table, sets it as a variable (say, ${NUMBER_OF_COPIES})
    - transform B: uses a transformation executor step, multiplied by ${NUMBER_OF_COPIES}, to run X instances of transform C
    - transform C: what you actually want to run

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.