Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Slow Load to Database

  1. #1

    Default Slow Load to Database

    I Have the same problem. A load of one milion (daily) records takes an average of 5 hours to run. Any solution?

  2. #2
    Join Date
    Nov 2009

  3. #3


    One other thing to consider is how long it takes to load data using the MySQL client on the same system where PDI is running.

    If you run a 'LOAD DATA' query with a CSV file, does it take just as long as PDI? There's a lot of variables in writing to a database: client configuration, server configuration, network. If you take PDI out of the equation and try using the MySQL native client, it may help identify whether it's a server/network configuration issue, and not just PDI.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.