Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: problem with data doubling

  1. #1
    Join Date
    Apr 2011
    Posts
    9

    Default problem with data doubling

    Hi,
    i have a strange problem. I use update component, but if current row is new row is directed to table output.
    Normally may transformations (about 40) work wine. But if it really work (automatically job runs at some intervals) i have a problem. Sometimes (maybe one for 10-20 runs) data was doubled. Its mean that current row is in target db but update component recognizes this row as a new (update lookup key failed). This situation take place one for 10-20 runs and in 1-2 for about 40 transformations.

    Have you any idea why?

  2. #2
    Join Date
    Nov 2008
    Posts
    777

    Default

    What sequence of steps are you using to verify the keys? Also, what is the format and datatype of the key? These things may help in solving the problem.
    pdi-ce-4.4.0-stable
    Java 1.7 (64 bit)
    MySQL 5.6 (64 bit)
    Windows 7 (64 bit)

  3. #3
    Join Date
    Apr 2011
    Posts
    9

    Default

    To verify keys i only use update component. I compare integers

    btw. I use 'make the transformation database transactional' option
    Last edited by miodas007; 11-09-2011 at 05:54 AM.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.