Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Large database join gives "OutOfMemoryError"

  1. #1

    Exclamation Large database join gives "OutOfMemoryError"

    I have a transformation that works with small-ish numbers of rows, but gives a memory error with larger numbers.

    It actually sounds a lot like story 2 at bug #2759, but I don't understand the solution to that bug.

    I've attached the log for more detail.

    Thanks!
    --Buck
    Attached Files Attached Files

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    The story is most likely unrelated although you can try to lower the row set size in the transformation to see if that makes a difference.

  3. #3

    Default

    Matt: That was exactly the solution!

    Where do I find documentation on what "rowset size" means?

    I also found that when I removed some slow steps from the end of my long transformation (Table Output), the buffers don't fill and I no longer have memory issues.

    Thanks!
    --Buck

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.