Hitachi Vantara Pentaho Community Forums
Results 1 to 6 of 6

Thread: Transformation/Job Templates

  1. #1

    Question Transformation/Job Templates

    Hi,

    I'm wondering whether there is the functionality in Kettle to have templates for Transformations/Jobs?

    My issue is that I am responsible for maintaining over 150 transformations in dozens of jobs.
    So when I need to make a bulk change it takes me hours to go through, one by one, and update them.

    So I'm hoping that I can have a few "Master" transformations/jobs that I can change generic stuff on.
    And then have that cascade down to all of the actual transformations/jobs.

    Thanks

    Update: I feel that I need to be more specific about this.
    Essentially I want to be able to have a template of the 'layout' of the transformation.
    By that I mean that I want to be able to create the whole data-flow in spoon.
    And then just update the parameters in the actual transformations.

    Example:
    I have 150ish transformations that all work fine, but I now need to add another 10 steps to each to get some metrics out for reporting.
    Is there a better way of doing this than copying, pasting & updating the steps into each transformation.

    Thanks
    Last edited by IAS_Tyler; 02-03-2014 at 09:52 PM.

  2. #2
    Join Date
    Oct 2007
    Posts
    107

    Default

    For the generic stuff that can be used in many transformation, I suggest you have a look at Mapping Input/Output specification (Mapping folder).

  3. #3

    Default

    Thanks for the quick reply. .

    I presume that you mean the Mapping Folder under Samples?
    I only have 2 really basic samples in that Folder.

    Could you possibly attach the one you suggested?

    Thanks

  4. #4
    Join Date
    Oct 2007
    Posts
    107

    Default

    No, I meant that when developping transformation, you should try to use the Mapping Input/output specifications step for the generic stuff that can be used accross many transformation. This means that whenever you have a change, you only change that portion once for all transformations that uses it.

    Name:  Mapping.png
Views: 30
Size:  10.2 KB

  5. #5

    Default

    Oh. Right.

    I'm not sure this will work for me.
    Because each of the different transformations have different amounts of columns, data types, etc.

    Maybe I should update my original post to be a bit more specific.

    But Thanks for your help.

  6. #6
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    I have a silly question.
    Since you have to change parameters in all those steps anyway, what's the advantage of having a template?
    You need to go through all of them manually anyway.
    -- Mick --

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.