Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Out of memory

  1. #1

    Default Out of memory

    Hi Guys,

    I am trying to read an xml file, which is of 650MB. Transformation is very simple:-
    Read from xml file --> pass it to dummy.

    now when i execute this transformation, pentaho throws an error "out of memory". I have set memory value in spoon.sh as :-
    PENTAHO_DI_JAVA_OPTIONS="-Xmx2048m"

    Any idea on how to make it working?

    Splitting file is not my choice as my client doesn't want me to do that.

    Any help will be highly appreciated.

    Regards,
    Ritesh

  2. #2
    Join Date
    Sep 2009
    Posts
    810

    Default

    Hi Ritesh,

    I've never used it myself, but I hear the prune option may allow you to parse a large file efficiently.
    http://wiki.pentaho.com/display/EAI/...ng+Large+Files

    Cheers

    Slawo

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.