Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: OutOfMemoryError running a simple update

  1. #1
    Join Date
    Jan 2006
    Posts
    12

    Default OutOfMemoryError running a simple update

    Attachment: update.ktr Hi,


    I'm trying to run a simple update process on ~200k records. After a while, the spoon process dies, without any explanation. Running it from a console, I managed to see that's about a "java.lang.OutOfMemoryError: Java heap space". I doubled the allocated jvm memory, but it only runs a little longer, then dies.



    Is there anything I can do to pass this point?



    Thanks,
    Alin

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default RE: OutOfMemoryError running a simple update

    Hi Alin,

    You can enable the console for Spoon too by uncommenting the java line in Spoon.bat and commenting out kettlew.
    Out-of-memory errors are unfortunately not easy to handle.
    The cause can be many things. For example if you use MySQL, a TableInput will load the complete table into memory. (this is not a Kettle issue but a driver problem)

    So, perhaps you can tell us a bit about your configuration, so that we can figure out a way around this problem?

    Thanks,

    Matt

  3. #3
    Join Date
    Nov 1999
    Posts
    9,729

    Default RE: OutOfMemoryError running a simple update

    >I attached the transformation I use.

    I disagree ;-)

  4. #4
    Join Date
    Jan 2006
    Posts
    12

    Default RE: OutOfMemoryError running a simple update


  5. #5
    Join Date
    Jan 2006
    Posts
    12

    Default RE: OutOfMemoryError running a simple update

    I get the data from SQL Server and I put it into Oracle. Before this, I had a simple read/insert transformation for over 30 mil records and it didn't hit this problem.

    I attached the transformation I use.

    Thanks for your quick response,
    Alin

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.