Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Detail Auditing options

  1. #1

    Default Detail Auditing options

    Hey all,
    I've reviewed and implemented http://kettle.pentaho.org/tips/?tip=9 for auditing some existing jobs and transformations.

    However, I think it may be insufficiently detailed when it comes to diagnostics related to performance issues within a Transformation -- particularly when the Transformation is running in different environments (for instance, 1k record duplicate checking vs 1million record duplicate checking was a scenario I just ran into).

    Are there any options or future plans to log LINES_READ/OUT/etc start-date/end-date for each STEP in a transformation (and possibly records/second and total time, although it could be derived)?

    The existing STEP logging in Spoon is sufficient, but not sure how to access it outside of Spoon (such as when running within the Pentaho BI Platform).

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    Log a JIRA tracker... first priority I think is getting 3.0 stable enough.

    Regards,
    Sven

  3. #3

    Default

    I'll make a JIRA entry soon -- want to make sure it wasn't something that is already solved (as it is within Spoon) and I just do not know how to pull it off.

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    I was planning to do this some day, even with charts, database logging and everything, but it's not going to happen in 3.0. So it will be a 2008 target I guess.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.