Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Improve performance with large number of columns

  1. #1

    Default Improve performance with large number of columns

    I am trying to move a Oracle database with 170 columns many of which are "BigIntegers" or large strings to a MySQL database. Even running the table input directly to a dummy step I am still getting only about 20 rows / second which is too slow. I have been able to get around 4000 r/s with other tools but I like the other Kettle features and would really like to figure out to improve this at all.

  2. #2
    Join Date
    Nov 1999
    Posts
    459

    Default

    I would check the Oracle driver version and tweak the JDBC driver properties. We are reading from the JDBC as fast as it comes in, so I believe JDBC / network / database - one of them or a combination is the bottle neck.

    Look at the "Performance Considerations" over here: http://wiki.pentaho.com/display/EAI/Oracle

    HTH,
    Jens

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.