Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Parsing invalid date or number value in a text file input step don't fails!!!

  1. #1
    Join Date
    Apr 2011
    Posts
    21

    Exclamation Parsing invalid date or number value in a text file input step don't fails!!!

    Hi everybody,

    I’m having big troubles when I do some testing with bad data. For example I have a text file looking like this:

    RECORD_DAY; RATIO_ID; RATIO_INDEX; RATIO_NAME; VALUE
    30.06.2011; 1210aaa007420; 515P_I; Some name; 1234.55
    31.22.2011; 1223454545; 515P_I; Some other name; 123.98

    The fields are defined as follows:

    RECORD_DAY(Date, dd.MM.yyyy)
    RATIO_ID(Number(10,5), #)
    RATION_INDEX(String(10))
    RATION_INDEX(String(100))
    RATION_INDEX(Number(15,5))

    When I start the transformation with this data, I expect that it will abort. But this isn't the case! The Transformation runs successfully and all the data is being processed. The result in the database is absolutely wrong!!!

    The invalid date 31.22.2011 is transformed to 31.10.2012 and the invalid number value gets cut to the first character and inserted as 1210 in the table. Why??? This cannot be a wished result! It has to produce a type conversion error. Other ways there isn't any possibility to do some error handling, because the ignore errors option doesn’t shows to advantage.


    Using a CSV input step isn't an option as well. When using this step the invalid data values are being replaced with NULLs, and turning error handling is not working, bad data is being processed anyways!

    Does anyone have some experience with any of these issues?

    Kind regards

  2. #2
    Join Date
    Sep 2009
    Posts
    810

    Default

    Hi there,

    would you be able to attach a test case for us? I'd gladly have a look.

    Cheers
    Slawo

  3. #3
    Join Date
    Apr 2011
    Posts
    21

    Default

    Hi Slawo,

    sure!

    Hier is a sample transformation and the input/output data for it.

    Cheers
    Desi
    Attached Files Attached Files

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.