Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Table output problem with postgress

  1. #1

    Default Table output problem with postgress

    We have a carte service running which uses 'Table output' to insert records into a postgress database.

    After some time the 'table output' hangs on a commit.
    This commit will continue after several minutes (around 10 minutes).

    We need to solve this problem.

    Before the 'Table output' step we have a 'Sort step'.
    If we remove the 'Sort step' we don't have any problem.
    We need the 'Sort', because we need to 'Merge' records before the 'Output', so removing the 'Sort' is not possible.

    Thnx.
    Eric
    Last edited by EricTonissen; 12-04-2017 at 03:53 AM.

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    I just wonder how many rows are involved and what your batch size might be.
    Did you check the Postgres logfile for what's happening during those 10 minutes?
    So long, and thanks for all the fish.

  3. #3

    Default

    The amount of rows is 500.000 and the batch size is 1000
    The Postgres logfiles tells us that it got inserts but no commit.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.