US and Worldwide: +1 (866) 660-7555
Results 1 to 4 of 4

Thread: pg_bulkload vs postgres bulk loader step

  1. #1
    Join Date
    Apr 2009
    Posts
    333

    Lightbulb pg_bulkload vs postgres bulk loader step

    Hi,

    I was checking if the postgres bulk loader step uses the pg_bulkload utility? I doubt, because i read from the wiki that it uses COPY DATA FROM STDIN. Some changes between copy and pg_bulkload are as mentioned here :
    http://pgbulkload.projects.postgresql.org/

    so should it be a better option to invoke a shell script from pentaho which runs the pg_bulkload?

    P.S. I had another query. . pentaho does not abort if there is an error in inserting a record while using postgres bulk loader any help on this to abort the process if some records fail to insert?
    Regards,
    Madhu

  2. #2
    Join Date
    Nov 1999
    Posts
    9,688

    Default

    Matt Casters, Chief Data Integration
    Pentaho, Open Source Business Intelligence
    http://www.pentaho.org -- mcasters@pentaho.org

    Author of the book Pentaho Kettle Solutions by Wiley. Also available as e-Book and on the Kindle reading applications (iPhone, iPad, Android, Kindle devices, ...)

    Join us on IRC server Freenode.net, channel ##pentaho

  3. #3
    Join Date
    Apr 2009
    Posts
    333

    Default

    Yep that is where I read already from :| .... I wanted to know if someone had actually tried both pg_bulkload and copy command and the difference in performance!!
    Regards,
    Madhu

  4. #4
    Join Date
    Apr 2009
    Posts
    333

    Default

    As for my second query, how do I fail the transformation, if an insert fails via bulkloader?
    Regards,
    Madhu

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •