Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Slow tranformation

  1. #1
    Join Date
    Mar 2010

    Default Slow tranformation


    I have a tranformation which has to add rows to a table and its child table. Also it has to do this at two points in the flow.

    Problem is : I have to set the commit size for the parent as 1 and and because of this the transformation takes long to execute(more than 1 hr to load 1L rows).

    If I dont set the commit size more than 1, i get an error related to locking.
    Any idea how to solve this problem so that the transformation takes less time to execute ?


  2. #2
    Join Date
    Nov 2008


    Try using some jobs.

    [START] -> [Save Parent] -> [Save Child] -> [Success]
    Keep in mind that you might wanna have a transformation before [Save Parent] that does some previous processing in order to optmize data flow.



Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.