Evaluation of multiple steps within a kettle job

[jerzy_s]

I have a job that runs multiple sub-jobs in parallel.
Upon completion of ALL sub-jobs I would like to start a follow up job.
How can I do this in KETTLE. There seems to be no good wait to do that.

I would also like to use similar evaluation in case of on or more of the sub-jobs failing - for example:
- if job A fails but B and C succeeds - > do action1
- if job B fails but C and A succeeds -> do action2
etc

anyway to do that kind of logic?

[rhaces]

Personally I would create a tmp file after a success execution (one per each job) and then all those jobs lead to a Check if files exist condition so with the first 3 jobs, it will fail, but when the 4th and final job finishes it will detect the 4 files exist and it will continue. See attached job.

[jerzy_s]

Thanks Rodrigo - that looks like a workable solution.

Maybe next version of Kettle will have a more robust Job evaluation selection?

[rhaces]

Maybe next version of Kettle will have a more robust Job evaluation selection?

Let me tell you that this is a very robust evaluation, I have used it in very complex and critical ETL solutions. Anyhow there are a lot of other ways of doing this, there might be another way of doing it. Anyhow I recommend you that if you want a single step to detect if all the jobs pointing to it have finished ok, you should create a JIRA (http://jira.pentaho.com) case requesting it as a feature request.

[MattCasters]

The solution is obviously simply to put all the parallel work in a sub-job.
The parent job will wait until it's all done.