Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Joberror while using "Launch next entries in parallel" -> workaround or check?

  1. #1
    Join Date
    Mar 2011
    Posts
    3

    Default Joberror while using "Launch next entries in parallel" -> workaround or check?

    Hi,

    for speeding up a daily job, I set the option "Launch next entries in parallel" at the start-icon of the job. The start-icon is followed by five "job-chains". The Repository is a database (Oracle 10.2), access via JDBC. Platform is Windows 2003 SP2 / Windows XP SP3.

    Now from time to time i get an error (this seems to be a known bug: http://jira.pentaho.com/browse/PDI-4568), the job ends with an error:

    2011/03/29 14:19:58 - REPOSITORY - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : A database error occured reading a transformation from the repository
    2011/03/29 14:19:58 - REPOSITORY - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.core.exception.KettleValueException:
    2011/03/29 14:19:58 - REPOSITORY - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : Unknown column 'VALUE_STR'
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.core.exception.KettleException:
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : Unexpected error during transformation metadata load
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) :
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : An error occured reading a transformation from the repository
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) :
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : Unknown column 'VALUE_STR'
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) :
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) :
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.entries.trans.JobEntryTrans.getTransMeta(JobEntryTrans.java:1142)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:594)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.Job.execute(Job.java:471)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.Job.execute(Job.java:600)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.Job.execute(Job.java:600)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.Job.execute(Job.java:600)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.Job.execute(Job.java:388)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.job.entries.job.JobEntryJobRunner.run(JobEntryJobRunner.java:63)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : java.lang.Thread.run(Thread.java:619)
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : org.pentaho.di.core.exception.KettleException:
    2011/03/29 14:19:58 - JOBNAME - ERROR (version 4.1.3, build 14870 from 2011-03-08 06.26.51 by anthony) : Unexpected error occurred while launching entry [TRANSFORMATION.0]


    If i take a look in the log regarding the timestamp on which the error occures, i can see that two jobs want to select metadata from the repository at the same time. Matt wrote for an earlier version of pentaho, this error is caused by a concurrency problem in the repository handler (http://wiki.pentaho.com/display/EAI/...es+in+parallel).

    Can i check this in a job or is there a workaround for this issue?

    The problem also exists, if i split the job-chains into five jobs and execute them in parallel.

    Best regards,
    Stefan
    Last edited by tweeeeeek; 03-29-2011 at 08:47 AM.

  2. #2
    Join Date
    Mar 2011
    Posts
    3

    Default Other suggestions for parallel execution of jobs?

    Hi,

    has anyone any suggestions for parallel execution of jobs? Or is the only possibility to do this to split the different jobs on different computers with their own repository? I hope not...

    Best regards,
    Stefan
    Last edited by tweeeeeek; 04-01-2011 at 04:26 AM.

  3. #3
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    I think you should really file a JIRA case with a sample so we can fix this right away!

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Sorry, adding your stack trace to the one from PD-4568 is fine too. The cases are not the same but similar enough.

  5. #5
    Join Date
    Mar 2011
    Posts
    3

    Default

    Hi Matt,

    thank you for your reply, i've commented the jira case PD-4568.

    Best regards,
    Stefan

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.