Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Prefixing log entry of step feedback row with transformation/job name

  1. #1

    Default Prefixing log entry of step feedback row with transformation/job name

    Is there a way to prefix the feedback row generated by a trasnformation step by its transformation name?

    We start a lot of transformations in parallel which have identical step names (exampel: lookup hub ID, insert link id, ...).

    In the console output generated by kitchen it is nearly impossible to identify the trasnforamtion which progides the feedback row.

    Prefixing the step name is a no-go. This would make ETL refactoring (renaming of transformation) painful.

    What came into mind was prefiixng the log feedback with its transformation name.

    Does anyone else have another solution to the problem?

    kind regards Max

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    If you put the logging in a database you know which transformation it comes from.
    If you put the logging in a filename that matches the transformation you know where it came from too.

    If you really want to dump everything into the same log file you can either tweak Log4J or do a little shell magic:

    Code:
    sh kitchen.sh /file="$FILENAME" | while read line; do echo "$FILENAME -- "$line; done
    HTH,
    Matt

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.