Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: How can many transformations run with a public datasource in a job ?

  1. #1

    Question How can many transformations run with a public datasource in a job ?

    hi:
    I make a job, and create many transfomations in the job ,
    I want to transfer the data of nearly fifty tables from mysql to oracle,
    there are two question trouble me:

    first:I have configured JNDI datasources for every transformation,now the job create many connections to database;
    so I think whether I can configure some public datasources in the job for the many transformation in it;

    secend: my job execute repeatedly , I set the job starting to run evervy minute ,
    originally , I set 514M memory in the kitchen.sh,and the log level is basic, thirty minutes later,there is a error , java out of memory;
    then ,I set 1024M memory in the kitchen.sh,and the log level is error, Forty minutes later,there is a error , java out of memory;
    finally , I set 4096M memory in the kitchen.sh,and the log level is error, nearly twelve hours later,there is a error , java out of memory;
    should I set more and more memory for the job ?
    is there anything else I can do ?

    Looking forward to anyone's advice ! thanks a lot !
    Last edited by liudongliang; 02-24-2011 at 08:56 AM.

  2. #2

    Default

    Looking forward to anyone's advice ,waiting...

  3. #3
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Click right on the database connection, select "Share". This will place it in ${KETTLE_HOME}/.kettle/shared.xml
    To prevent an out of memory error, use less memory. :-)

  4. #4

    Default

    :-) Thanks a lot ! Matt ! Wonderful!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.