Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: PDI logging table - Error for missing columns

  1. #1
    Join Date
    Nov 2016
    Posts
    2

    Default PDI logging table - Error for missing columns

    Hi,

    I am trying to set up a log table on job level.
    i created a table on my postgres DB with only selected fields as follow:

    CREATE TABLE public.log_kettle
    (
    ID_JOB INTEGER
    , JOBNAME VARCHAR(255)
    , STATUS VARCHAR(15)
    , ERRORS BIGINT
    , LOGDATE TIMESTAMP
    , REPLAYDATE TIMESTAMP
    , LOG_FIELD TEXT
    , EXECUTING_USER VARCHAR(255)
    )
    ;

    I do not want all table fields that kettle offers.

    In the job properties I set the connection and the log table and disabled all the fields that are not needed.

    However when I run the job I am getting error for the missing fields. Kettle runs the following query:

    SELECT ID_JOB, STATUS, LINES_READ, LINES_WRITTEN, LINES_UPDATED, LINES_INPUT, LINES_OUTPUT, LINES_REJECTED, ERRORS, STARTDATE, ENDDATE, LOGDATE, DEPDATE, REPLAYDATE, LOG_FIELD, EXECUTING_USER FROM public.log_kettle WHERE JOBNAME LIKE ? ORDER BY ID_JOB DESC

    And then raises exception for all the missing columns.

    I do not know why the disabled columns are not remove from the query.
    Is there any other configuration that I missed? or it is a bug?

    I am using Kettle CE version 6.1.

    Of course that when I create the log table with all the columns, everything is working fine.

    Thanks for your help

  2. #2

    Default

    Hi,

    Am using the similar logging mechanism and it never shows me any error for missing fields. But I have a doubt, have you ever tried to customise the logging kettle provides? I wish to add extra columns than what kettle allows. I have tried to work around this but had no success. I ended up creating my own log table. Do you know any idea if there is a way to use the kettle's internal logging that can be customised?

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.