Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Memory problem with Spoon / Kitchen (already increased heap size)

  1. #1

    Default Memory problem with Spoon / Kitchen (already increased heap size)

    I've already increased the Java Heap size with

    Code:
    PENTAHO_DI_JAVA_OPTIONS="-Xmx2048m -XX:MaxPermSize=512m".
    but I'm still running out of memory. This is occurring with a table with several millions of rows, but each row only has 5 columns and they're very small (date, int, etc.)

    I'm getting this on a very simple extract script. Table Input->Table Output

    I tried dropping down the commit size to 100 rows, but that doesn't seem to help. The memory used goes up past 2Gb, and then Spoon hangs (on my Win 7 64 bit OS).

    Is there any thing I can do in the script to keep the number of rows in memory down? Any reason why this table should use so much memory?

  2. #2
    Join Date
    Nov 2009
    Posts
    688

    Default

    Try to decrease the logging size. See: http://infocenter.pentaho.com/help/t...og_params.html

  3. #3

    Default

    Thanks. I'll try that. It says this is for Spoon. Does it work for Kitchen too?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.