Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Rerunning transformations

  1. #1

    Default Rerunning transformations

    Hi ,

    I had a job contains 10 transformations which are in sequence .It throws the error when I am trying to running the job at 9th transformation.
    I had fix the issue and re run the job ,it will starts from 1st transformation onwards.How can i avoid that rerunning which are already run , is there any option to stop it.
    Please anyone can help me....


    Thanks,
    Deepa

  2. #2
    Join Date
    Jul 2011
    Posts
    21

    Default

    Quote Originally Posted by deepa.nannapaneni View Post
    Hi ,

    I had a job contains 10 transformations which are in sequence .It throws the error when I am trying to running the job at 9th transformation.
    I had fix the issue and re run the job ,it will starts from 1st transformation onwards.How can i avoid that rerunning which are already run , is there any option to stop it.
    Please anyone can help me....


    Thanks,
    Deepa
    I think you should create a temporary file at the end of each transformation. In the parent job you can check whether that file has been set (or not) with the "check if file exists" step. If it existst, go to the next "check if file exists". If not, run the transformation. In the last transformation, you delete all the temporary files.


    For example:

    JOB:
    1 - check if temp_1.txt is available;
    - If so, go to 3;
    - If not, go to 2;

    2 - Run transformation 1 (at the end, create a file called temp_1.txt);

    3 - check if temp_2.txt is available;
    - If so, go to 5;
    - If not, go to 4;

    4 -Run transformation 2 (at the end, create a file called temp_2.txt);

    5 - check if temp_3.txt is available;
    - If so, go to 7;
    - If not, go to 6;

    6 -Run transformation 2 (at the end, create a file called temp_3.txt);
    etc.
    etc.

    Final step: delete all temp_X.txt files.

    Maybe there is a quicker/better way, but this will work. Good luck.

  3. #3
    Join Date
    Aug 2007
    Posts
    28

    Default

    You can analyze the log for your job and all transformations for this job, based on this analysis set up a variable like trans_status 0 - previous job was success, 1 - fail on first transformation, 2 - fail on second .... etc;
    first step will be to figure out step you job failed, after taht simple case statement will do the jonb case var = 0 start from beginning, if not 0 start from desired transformation

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.