Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Java heap space error.

  1. #1

    Default Java heap space error.

    Hi All,

    I have pentaho 4.1.0-stable version.

    I have one kettle job from which I am calling 4000 transformations(each transformation has table input --> intermediate steps --> table output steps).

    I am running job from command prompt with the kitchen.sh as follows:
    /opt/kettle/kitchen.sh /file:/opt/job.xml level:"detailed logging" -Xms1024m -Xmx3584m

    I modified kitchen.sh to accept xms and xmx parameters accordingly and its taking those parameter correctly.After executing 1000+ transformations, kitchen.sh throws java heap space exception.
    Prashant D Shelke.

  2. #2
    Join Date
    Nov 2008
    Posts
    271

    Default

    Hi pdshelke,

    did you try and set the logging level to minimal? Alternatively, try tuning the log size or timeout via the two variables in kettle.properties

    KETTLE_MAX_LOG_SIZE_IN_LINES
    KETTLE_MAX_LOG_TIMEOUT_IN_MINUTES

    HTH
    Andrea Torre
    twitter: @andtorg

    join the community on ##pentaho - a freenode irc channel

  3. #3

    Default

    In-between, I tried one other way is, I created 5 streams and added 800 transformation in one stream(as I have total 4000 tables.) in job xml.
    This worked for me.

    But still want to run job with single stream, so will try option suggested by you.

    Thanks for suggestions.
    Prashant D Shelke.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.