Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Join with deleted rows logged...

  1. #1
    Join Date
    Oct 2007
    Posts
    25

    Default Join with deleted rows logged...

    Hi all.

    I'm new to pentaho and I'm struggling with a problem.
    I've been reading the documentation but I didn't find an object to solve my problem.

    What I need is to join a bunch of data already loaded in the flow with a database table. I accomplished this easily. The problem is to redirect the dropped rows to a log file. So, I need to join two tables and send the data from one of them to a log file, in case the join misses.

    Thanks for the help.
    Gustavo

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    The "Merge Rows" step can compare 2 streams of data (sorted on the key) and tell you if a row is new, deleted, changed or identical.

    HTH,

    Matt

  3. #3
    Join Date
    Oct 2007
    Posts
    25

    Default

    Thank you for the answer.

    What the "Merge Rows" does is comparing 2 streams that are similar in their data structure. I don't want this.

    Let me explain it better. I want to join Products with Product_Features, they have a key relationship. The Products sucessfully inner joined are sent to the next step of the flow, and the Products removed with the inner join are logged to a file.

    Makes sense?

    Thanks in advance,
    Gustavo

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    You use an outer join if you want all the rows to pass the merge join step.
    Then you can simply split the stream with a filter on the second key (is null or not).

    Matt

  5. #5
    Join Date
    Oct 2007
    Posts
    25

    Default

    So easy.... Thank you!

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.