Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: How to improve the performance of TableInput step?

  1. #1
    Join Date
    Jul 2009
    Posts
    3

    Default How to improve the performance of TableInput step?



    Current Situation:
    As the image show my transformation design, the TableInput step extract 11,000 rows per second, and can not agree with the requirement, and how to improve the speed, maybe pagination and parallel is more better, but how to ? thanks.

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    If you disable the last hop in the transformation, how fast does it run then?

  3. #3
    Join Date
    Jul 2009
    Posts
    3

    Default

    hi, thanks for your attention, 5,500 rows per seconds.

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    If it's really the "Table Input" that is slowest there is very little you can do.
    However, investigating why the step is slow is a good idea. If the network to the database is slow that will be the reason.
    If the database query or the database is slow that's another reason.
    Depending on which it is you can make changes and improve the situation.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.