Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Multiple Kitchen log entries (console)

  1. #1
    Join Date
    Dec 2017
    Posts
    2

    Default Multiple Kitchen log entries (console)

    Hi,

    I'm trying to better configure my console log4j output adding a tag to that. I altered the file /opt/data-integration/plugins/kettle5-log4j-plugin/log4j.xml file as follow:
    Code:
    <!DOCTYPElog4j:configuration SYSTEM "log4j.dtd"><log4j:configuration xmlns:log4j='http://jakarta.apache.org/log4j/'>
     
      <appender name="console" class="org.apache.log4j.ConsoleAppender">
        <param name="Target" value="System.out"/>
        <layout class="org.apache.log4j.PatternLayout">
        <param name="ConversionPattern" value="%d{yyyy-MM-dd HH:mm:ss} TEST LOGGING - %m%n" />
        </layout>
      </appender>
     
       <logger name="org.pentaho.di">
        <level value="on"/>
        <appender-ref ref="console" />
      </logger>
     
      <root>
        <priority value ="off"></priority>
        <appender-ref ref="console"></appender-ref>
      </root>
     
    
    </log4j:configuration>
    When I run my simple job
    Code:
    ./kitchen.sh -file ~/Desktop/job.kjb
    I get the following results in my console output:
    Code:
    ...
    2018/09/18 11:42:43 - job - Start of job execution
    2018-09-18 11:42:43 TEST LOGGING - job - Start of job execution
    2018/09/18 11:42:43 - Carte - Installing timer to purge stale objects after 1440 minutes.
    2018-09-18 11:42:43 TEST LOGGING - Carte - Installing timer to purge stale objects after 1440 minutes.
    2018/09/18 11:42:43 - job - Starting entry [Transformation]
    2018-09-18 11:42:43 TEST LOGGING - job - Starting entry [Transformation]
    2018/09/18 11:42:43 - Transformation - Loading transformation from XML file [file:///home/caio/Desktop/blah.ktr]
    2018-09-18 11:42:43 TEST LOGGING - Transformation - Loading transformation from XML file [file:///home/caio/Desktop/blah.ktr]
    2018/09/18 11:42:43 - Transformation - Using run configuration [Pentaho local]
    2018-09-18 11:42:43 TEST LOGGING - Transformation - Using run configuration [Pentaho local]
    2018/09/18 11:42:43 - Transformation - Using legacy execution engine
    2018-09-18 11:42:43 TEST LOGGING - Transformation - Using legacy execution engine
    2018/09/18 11:42:43 - blah - Dispatching started for transformation [blah]
    2018-09-18 11:42:43 TEST LOGGING - blah - Dispatching started for transformation [blah]
    2018/09/18 11:42:44 - Table input.0 - Finished reading query, closing connection.
    2018-09-18 11:42:44 TEST LOGGING - Table input - Finished reading query, closing connection.
    2018/09/18 11:42:44 - Table input.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
    2018-09-18 11:42:44 TEST LOGGING - Table input - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0)
    2018/09/18 11:42:44 - job - Starting entry [Success]
    2018-09-18 11:42:44 TEST LOGGING - job - Starting entry [Success]
    2018/09/18 11:42:44 - job - Finished job entry [Success] (result=[true])
    2018-09-18 11:42:44 TEST LOGGING - job - Finished job entry [Success] (result=[true])
    2018/09/18 11:42:44 - job - Finished job entry [Transformation] (result=[true])
    2018-09-18 11:42:44 TEST LOGGING - job - Finished job entry [Transformation] (result=[true])
    2018/09/18 11:42:44 - job - Job execution finished
    2018-09-18 11:42:44 TEST LOGGING - job - Job execution finished
    2018/09/18 11:42:44 - Kitchen - Finished!
    2018-09-18 11:42:44 TEST LOGGING - Kitchen - Finished!
    2018/09/18 11:42:44 - Kitchen - Start=2018/09/18 11:42:18.901, Stop=2018/09/18 11:42:44.039
    2018-09-18 11:42:44 TEST LOGGING - Kitchen - Start=2018/09/18 11:42:18.901, Stop=2018/09/18 11:42:44.039
    2018/09/18 11:42:44 - Kitchen - Processing ended after 25 seconds.
    2018-09-18 11:42:44 TEST LOGGING - Kitchen - Processing ended after 25 seconds.
    ...
    As you can see, after enabling appender-ref console to value=on, my log entries start doubling. How can I keep just the entry with the TEST LOGGING I configured?

    Thank you

  2. #2
    Join Date
    Aug 2016
    Posts
    290

    Default

    Logging in Kettle is a mystery to me. I only write to log file manually, and set all log levels to "Error only". That way I get full log in case sometehing goes wrong, otherwise only custom log which I can control completely.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.