Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Documenting a Transform

  1. #1
    Join Date
    Apr 2008
    Posts
    15

    Default Documenting a Transform

    Hi -

    I have a requirement to document any executed transformations in a 'human readable' format. Is there an easy way to pull the metadata out of a transformation and throw it into a parseable format? I can include the 'picture' of the transform but that doesn't satisfy the requirement.

    For each column in the output, I need to grab the output mapping, the source of each column(Origin Step will do if I am diligent about retitling my steps), and anything from the input that didn't make it to the output.

    This only needs to be done on a macro level (I don't need to collect it by row, just for the transform), so I'd prefer to extend Kettle rather than do a plugin that generates this at runtime. Does anyone have anything that already does something like this? If not, are there any source code hooks I could call if I extend Kettle?

    Thanks -

    Keith

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    Nothing out of the box yet <= 3.1 ... something like what you want does exist somewhere, but is for the moment not included in PDI.

    Regards,
    Sven

  3. #3
    Join Date
    Apr 2008
    Posts
    15

    Default

    What's the chance of getting this unsupported code released - maybe not as part of Kettle but for reference purposes at least?

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default Reflection

    My plan is to create a set of steps to extract metadata from transformations and jobs.
    That way, the metadata (including impact analyses) could be stored in a database and analyzed off-line.

    API-wise it's all pretty simple, but doing this would unlock interesting information at virtually no cost inside Kettle itself.
    Allowing Kettle to look inside ETL metadata is also the way forward (IMHO) for auto-generating documentation, etc.

    Take care,

    Matt

  5. #5
    Join Date
    May 2008
    Posts
    10

    Default Check out this related thread on documentation

    I posted a thread of documenting the ktr and kjb files using xslt.
    http://forums.pentaho.org/showthread...+documentation

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.