Hitachi Vantara Pentaho Community Forums
Results 1 to 8 of 8

Thread: Managing the execution of multiple jobs

  1. #1
    Join Date
    Jun 2009
    Posts
    17

    Default Managing the execution of multiple jobs

    Challenge:

    If a job in a multi-job process fails, exit the process, and send an email alert.

    Question:
    Assuming 4 jobs:

    Job 1 - Process DimCustomer
    Job 2 - Process DimProduct
    Job 3 - Process FactSales

    If Job 1 fails, abort the process, and send email
    If Job 2 fails, abort the process, and send email
    If Job 3 fails, abort the process, and send email

    So, does kettle have a job scheduler which allows you to setup a "container" of jobs, to accomodate the above process?

    Enterprise ETL requirements force separation of process, such that I would not combine any of the above into a single job.

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    There are 3 types of people:

    - Those that can count to 4
    - Those that can't count to 4

    Joking aside, the type of logic you describe is exactly what happens inside of a PDI Job. Since you can nest, re-use and shallow copy these job entries I would like to think you can do all these things.

  3. #3
    Join Date
    Jun 2009
    Posts
    17

    Default

    Ok - How do you hop multiple jobs together? I have only hopped transforms together.

  4. #4
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    You had the count right the first time....

    4 Jobs.
    Job 0 - Container Job
    Job 1 - Process DimCustomer
    Job 2 - Process DimProduct
    Job 3 - Process FactSales

    Job 0 calls Job 1.
    On Success call Job 2. Else Mail.
    On Success call Job 3. Else Mail.
    On Success exit. Else Mail.

  5. #5
    Join Date
    Jun 2009
    Posts
    17

    Default

    Quote Originally Posted by gutlez View Post
    You had the count right the first time....

    4 Jobs.
    Job 0 - Container Job
    Job 1 - Process DimCustomer
    Job 2 - Process DimProduct
    Job 3 - Process FactSales

    Job 0 calls Job 1.
    On Success call Job 2. Else Mail.
    On Success call Job 3. Else Mail.
    On Success exit. Else Mail.

    I am struggling with how, in the UI, to setup a "container job" that connects jobs together (instead of tranaformations).

  6. #6
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    In the Job design, under "General" there are both Transformation Entries and Job Entries.

    They configure pretty much like transformations in the job.

  7. #7
    Join Date
    Jun 2009
    Posts
    17

    Default

    Quote Originally Posted by gutlez View Post
    In the Job design, under "General" there are both Transformation Entries and Job Entries.

    They configure pretty much like transformations in the job.
    Perfect - Thanks.

  8. #8
    Join Date
    Jun 2009
    Posts
    17

    Default

    Quote Originally Posted by dadumas View Post
    Perfect - Thanks.
    Perfect - Thanks!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.