Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Slow Load to Database

  1. #1

    Default Slow Load to Database

    I Have the same problem. A load of one milion (daily) records takes an average of 5 hours to run. Any solution?

  2. #2
    Join Date
    Nov 2009
    Posts
    677

  3. #3

    Default

    One other thing to consider is how long it takes to load data using the MySQL client on the same system where PDI is running.

    If you run a 'LOAD DATA' query with a CSV file, does it take just as long as PDI? There's a lot of variables in writing to a database: client configuration, server configuration, network. If you take PDI out of the equation and try using the MySQL native client, it may help identify whether it's a server/network configuration issue, and not just PDI.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.