Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: PostgreSQL Bulk Loader - don't fail on bad input

  1. #1
    Join Date
    Jan 2014
    Posts
    3

    Default PostgreSQL Bulk Loader - don't fail on bad input

    Is there a way for the PostgreSQL Bulk Loader to continue doing inserts even if it encounters bad input? As in, it should continue inserting the rows that are valid, and if it encounters one that is invalid, it will drop it and continue processing. When bulk loading large amount of data, I would prefer it to not die immediately just because of one bad data point. Unchecking "Stop on error" doesn't seem to help. It will continue, but I don't see any inserts occurring.

  2. #2
    Join Date
    Jul 2009
    Posts
    476

    Default

    I'm pretty sure that the answer is no, because the PG Bulk Loader step uses the PG "copy" command under the covers, and that command quits when it encounters a bad row. From http://www.postgresql.org/docs/9.3/s...sql-copy.html:

    COPY stops operation at the first error.

  3. #3
    Join Date
    Jan 2014
    Posts
    3

    Default

    Quote Originally Posted by robj View Post
    I'm pretty sure that the answer is no, because the PG Bulk Loader step uses the PG "copy" command under the covers, and that command quits when it encounters a bad row. From http://www.postgresql.org/docs/9.3/s...sql-copy.html:
    Hmm... OK. That makes sense. Thanks!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.