Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: how can I speed up the initialization time for flow steps

  1. #1
    Join Date
    Jun 2016
    Posts
    7

    Default how can I speed up the initialization time for flow steps

    Hi,

    Our flow contains almost one thousand steps, and we run the flow in java codes, every time it will take a long time to initialization all the flows, how can we speed up the initialization time? Can we for example compile all the ktr file into one jar file to speed up the flow?

  2. #2
    Join Date
    Aug 2011
    Posts
    360

    Default

    What do you mean by "flow contains one thousand step"?
    Do you mean you have
    A. one transformation with 1000 steps,
    or
    B. 1000 transformations?

    If A.:
    That's waaayyyyy to much! Each step run in its own thread, so this you mean you are launching 1000 threads at once!
    I think some refactoring might be a good idea....

    If B.:
    Maybe you dont need to init all transformations at start time.
    Just lazy init them when needed, this will smooth your process.

    But if you have one job holding 1000 transformation entry....that seems also waayy too much.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.