Hitachi Vantara Pentaho Community Forums
Results 1 to 9 of 9

Thread: Visualize Transformations and Jobs Structure

  1. #1
    Join Date
    Sep 2011
    Posts
    171

    Default Visualize Transformations and Jobs Structure

    Hello Everyone,

    As I progress through PDI, I see that my setup is getting more and more complicated, I wonder if there is any way to visualize all jobs and transformations included in one particular job. (I have to use pen and paper to do it now)?


    Regards,
    Alex

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Did you look at the Kettle Cookbook project?

    http://code.google.com/p/kettle-cookbook/

  3. #3
    Join Date
    Sep 2011
    Posts
    171

    Default

    Excellent!

    Do I need to get KFF in order to use Cookbook?

    Here is what I found: http://wiki.pentaho.com/display/EAI/...le%29+Projects

    However, it is not very clear where to get certain files such kettle.xsl

    Regards,
    Alex

  4. #4
    Join Date
    Nov 2008
    Posts
    271

    Default

    Hi Alex,
    you only need to download the .zip from the google code page. Basically it's a job that gathers all info about your transformations via xml, and gives you back an html. You can find a wiki as well at the link provided by Matt.

    Cheers
    Andrea Torre
    twitter: @andtorg

    join the community on ##pentaho - a freenode irc channel

  5. #5
    Join Date
    Sep 2011
    Posts
    171

    Default

    Thank you Andrea!

    I created two folders and placed simple transformation in input folder. I changed settings, but received the following error:
    I have not idea how to troubleshoot.
    index.html points to nowhere.


    2011/09/30 16:05:50 - Spoon - Starting job...
    2011/09/30 16:05:50 - main - Start of job execution
    2011/09/30 16:05:50 - main - Starting entry [Create ${OUTPUT_DIR} and Copy Template]
    2011/09/30 16:05:50 - Create ${OUTPUT_DIR} and Copy Template - Starting ...
    2011/09/30 16:05:50 - Create ${OUTPUT_DIR} and Copy Template - Processing row source File/folder source : [${Internal.Job.Filename.Directory}/../template] ... destination file/folder : [${OUTPUT_DIR}]... wildcard : [.+]
    2011/09/30 16:05:50 - Create ${OUTPUT_DIR} and Copy Template - Processing row source File/folder source : [${Internal.Job.Filename.Directory}/../template/css] ... destination file/folder : [${OUTPUT_DIR}/css]... wildcard : [.+]
    2011/09/30 16:05:51 - Create ${OUTPUT_DIR} and Copy Template - Processing row source File/folder source : [${Internal.Job.Filename.Directory}/../template/js] ... destination file/folder : [${OUTPUT_DIR}/js]... wildcard : [.+]
    2011/09/30 16:05:51 - Create ${OUTPUT_DIR} and Copy Template - Processing row source File/folder source : [${Internal.Job.Filename.Directory}/../template/images] ... destination file/folder : [${OUTPUT_DIR}/images]... wildcard : [.+]
    2011/09/30 16:06:00 - Create ${OUTPUT_DIR} and Copy Template - Processing row source File/folder source : [${Internal.Job.Filename.Directory}/../template/html] ... destination file/folder : [${OUTPUT_DIR}/html]... wildcard : [.+]
    2011/09/30 16:06:00 - main - Starting entry [process-files.ktr]
    2011/09/30 16:06:00 - process-files.ktr - Loading transformation from XML file [file:///C:/Users/sviridap/Downloads/data-integration/Kettle-cookbook/pdi/process-files.ktr]
    2011/09/30 16:06:00 - process-files - Dispatching started for transformation [process-files]
    2011/09/30 16:06:01 - Get Saxon Jar.0 - Finished processing (I=0, O=0, R=0, W=2, U=0, E=0)
    2011/09/30 16:06:01 - transform_script, is_windows.0 - Setting environment variables...
    2011/09/30 16:06:01 - transform_script, is_windows.0 - Set variable FULL_TRANSFORM_SCRIPT to value [N:\Daily Positions\State Street\Pentaho\OutputForDocumentation\transform.bat]
    2011/09/30 16:06:01 - transform_script, is_windows.0 - Set variable IS_WINDOWS to value [Y]
    2011/09/30 16:06:01 - filename -> saxon.jar.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Unexpected error
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : org.pentaho.di.core.exception.KettleStepException:
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Only 1 input row was expected to set the variables and at least 2 were received.
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) :
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.steps.setvariable.SetVariable.processRow(SetVariable.java:90)
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
    2011/09/30 16:06:01 - transform_script, is_windows.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at java.lang.Thread.run(Unknown Source)
    2011/09/30 16:06:01 - transform_script, is_windows.0 - Finished processing (I=0, O=0, R=2, W=1, U=0, E=1)
    2011/09/30 16:06:01 - process-files - process-files
    2011/09/30 16:06:01 - process-files - process-files
    2011/09/30 16:06:01 - <index>.0 - Finished processing (I=0, O=0, R=2, W=1, U=0, E=0)
    2011/09/30 16:06:01 - output wildcard.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2011/09/30 16:06:01 - match windows.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - html path.0 - Finished processing (I=0, O=0, R=2, W=4, U=0, E=0)
    2011/09/30 16:06:01 - process-files - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Errors detected!
    2011/09/30 16:06:01 - process-files - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Errors detected!
    2011/09/30 16:06:01 - Prepare Saxon/Java commandline.0 - Finished processing (I=0, O=0, R=2, W=6, U=0, E=0)
    2011/09/30 16:06:01 - system date.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - ${OUTPUT_DIR} -> folderName.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - is windows?.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - input wildcard.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2011/09/30 16:06:01 - .bat.0 - Finished processing (I=0, O=0, R=2, W=2, U=0, E=0)
    2011/09/30 16:06:01 - ${INPUT_DIR} -> folderName.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)
    2011/09/30 16:06:01 - Combine.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:01 - Get ${INPUT_DIR} and ${OUTPUT_DIR}.0 - Finished processing (I=0, O=0, R=2, W=8, U=0, E=0)
    2011/09/30 16:06:01 - relative input path.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:01 - relative output path.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:01 - index / file.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : Unexpected error
    2011/09/30 16:06:01 - index / file.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : java.lang.NullPointerException
    2011/09/30 16:06:01 - index / file.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.steps.xmljoin.XMLJoin.processRow(XMLJoin.java:93)
    2011/09/30 16:06:01 - index / file.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:40)
    2011/09/30 16:06:01 - index / file.0 - ERROR (version 4.2.0-stable, build 15748 from 2011-09-08 13.11.42 by buildguy) : at java.lang.Thread.run(Unknown Source)
    2011/09/30 16:06:01 - index / file.0 - Finished processing (I=0, O=0, R=0, W=0, U=0, E=1)
    2011/09/30 16:06:01 - Get ${OUTPUT_DIR} SubFolders.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:01 - Get ${INPUT_DIR} SubFolders.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:01 - index / folder.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0)
    2011/09/30 16:06:02 - process-files - process-files
    2011/09/30 16:06:02 - process-files - process-files
    2011/09/30 16:06:03 - main - Finished job entry [process-files.ktr] (result=[false])
    2011/09/30 16:06:03 - main - Finished job entry [Create ${OUTPUT_DIR} and Copy Template] (result=[false])
    2011/09/30 16:06:03 - main - Job execution finished
    2011/09/30 16:06:03 - Spoon - Job has ended.

  6. #6
    Join Date
    Nov 2008
    Posts
    271

    Default

    It's a known bug, easy to fix though.

    http://forums.pentaho.com/showthread...light=cookbook

    Regards
    Andrea Torre
    twitter: @andtorg

    join the community on ##pentaho - a freenode irc channel

  7. #7
    Join Date
    Sep 2011
    Posts
    171

    Default

    Awesome, it worked!

  8. #8
    Join Date
    Sep 2011
    Posts
    171

    Default

    I wonder if I can generate something similar to this page graph

    http://www.cloud2land.com/2011/06/pe...es/#comment-88

  9. #9
    Join Date
    Apr 2008
    Posts
    1,771

    Default

    Hi..
    I think that it's not possible :-(
    That's a lot of patience and photoshop!

    I have used Kettle Cookbook to create some documentation and I thought that it's great, but it's not so straight forward to implement.
    Is there any plan to improve it?

    When there will be a new version which will work with PDI 4.2?

    Thanks.
    Mick

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.