Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Text file output -data not being written

  1. #1
    Join Date
    Jun 2017
    Posts
    3

    Default Text file output -data not being written

    HI,
    I am facing really strange problem. I am using kafka consumer plugin to receive continuous data which gets processed and then gets written to Mongodb using REST client plugin.

    If any error occurs from REST client, i am capturing API response in text file using text file output.

    My problem is, even though response came from REST Client, it shows as written to file but when i open it its empty. AS im using kafka consumer, transformation runs continuosly.
    When i stop transformation, REST response gets written to text file and i can see it as well.

    I want to see data while transformation is running and i dont want to stop running transformation. Please suggest. I am using PDI 7.2

  2. #2
    Join Date
    Nov 2009
    Posts
    688

    Default

    PDI 7.2 is not a regular version so I think you are using 7.1?
    Is it due to the fact that the default settings for a transformation is a nr of rows in a rowset is 10000? So the text output wil wait till it receive 10000 records and then it will write those lines to the text file. You can try to lower that amount to see if that is the problem

  3. #3

    Default

    Hi Johan,
    Please make sure that you have defined all the fields required in the "Fields" tab of text file output

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.