Hitachi Vantara Pentaho Community Forums
Results 1 to 7 of 7

Thread: Capture hop result in job level

  1. #1
    Join Date
    Dec 2016
    Posts
    17

    Default Capture hop result in job level

    Hello all,

    I have one job that have lets say N different independent branch of transformation that run independently, once all transformation run successfully ONLY THAN after that I want to run one more transformation.
    So is there a way I can capture HOP result or transformation status at JOB level so that if all well execute last transformation.
    Please find image of the same problem, could you give better idea.
    Attached Images Attached Images  

  2. #2
    Join Date
    May 2016
    Posts
    282

    Default

    Unfortunately PDI doesn't manage this out of the box, I had to set it up using a database to control when each branch begins and finishes, there are other workarounds, I think I read a blog post at the time about using files to set up the controls.
    Name:  20180309_001.jpg
Views: 59
Size:  21.8 KB
    Name:  20180309_002.jpg
Views: 58
Size:  29.2 KB
    This is working for me, but I think PDI should have this managed in jobs without building it, other tools offer ways to manage it.
    OS: Ubuntu 16.04 64 bits
    Java: Openjdk 1.8.0_131
    Pentaho 6.1 CE

  3. #3
    Join Date
    Aug 2016
    Posts
    290

    Default

    What about launching the transformations inside a "root" transformation instead of a job? You can control this wait-until-steps-finished logic much easier there.

  4. #4
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    It says "All steps in parallel after this" .. Your design (as drawn) will execute T6 a number of times.

    If you want to accomplish what you are talking about you have to put in a few extra wrappers.
    Job 1:
    S -> J2 -> T6 -> End

    Job2:
    S-> Parallel (T1 / T2 / T3 / J3 ) -> End

    Job3:
    S-> T4 -> T5 -> End

    Job 2 won't end until Job 3 Ends. Job 1 won't move on to T6 until Job 2 ends.

  5. #5
    Join Date
    May 2016
    Posts
    282

    Default

    Quote Originally Posted by gutlez View Post
    Job2:
    S-> Parallel (T1 / T2 / T3 / J3 ) -> End
    Hi gutlez,
    I might be wrong, but the problem I found when implementing parallel execution, is that the End job in Job2 gets invoked for each of the parallel branches when the branch finishes, so T6 in Job1 gets invoked 4 times anyway, that is the reason why I implemented my workaround. Am I wrong?
    Regards
    OS: Ubuntu 16.04 64 bits
    Java: Openjdk 1.8.0_131
    Pentaho 6.1 CE

  6. #6
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    Sorry, I laid it out poorly.
    Simply delete all the "-> End" parts.

    S-> Parallel (T1 / T2 / T3 / J3 )

    The Parent job won't move on to T6 until all the T1, T2, T3 and J3 are done.

  7. #7
    Join Date
    May 2016
    Posts
    282

    Default

    Quote Originally Posted by gutlez View Post
    Sorry, I laid it out poorly.
    Simply delete all the "-> End" parts.

    S-> Parallel (T1 / T2 / T3 / J3 )

    The Parent job won't move on to T6 until all the T1, T2, T3 and J3 are done.
    I wasn't aware that was possible, I thought the End job step was mandatory... I'll try it out
    Thanks gutlez
    OS: Ubuntu 16.04 64 bits
    Java: Openjdk 1.8.0_131
    Pentaho 6.1 CE

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.