Hitachi Vantara Pentaho Community Forums
Results 1 to 7 of 7

Thread: merge two streams

  1. #1

    Default merge two streams

    Hello,

    I would like to merge the outputs from 2 steps in the following way (steps have same outputs). How can I do it? Thanks

    id name
    1 John
    2 Anna
    3 Kevin


    id name
    4 Robert
    5 Nick
    6 Bruno

  2. #2
    Join Date
    Sep 2011
    Posts
    152

    Default

    could you please tell what are the option you tried ? because its pretty straight forward.

  3. #3

    Default

    yes, I tried merge join and simple union to a dummy step. The problem is I have an extra column in a second table

    id name
    1 John
    2 Anna
    3 Kevin


    id name city
    4 Robert London
    5 Nick London
    6 Bruno London

  4. #4
    Join Date
    May 2014
    Posts
    358

    Default

    Add the city column to the first stream with a constant/null value, then you can union the streams.

  5. #5
    Join Date
    Nov 2009
    Posts
    688

    Default

    Or use "Stream Schema Merge" step. This can be downloaded from marketplace

  6. #6

    Default

    I used multiway merge join using full outer join type and two ID keys. Not sure if this was the "most" elegant solution but I think it does the same thing as you advised "Add the city column to the first stream with a constant/null value, then you can union the streams."

  7. #7
    Join Date
    Nov 2013
    Posts
    382

    Default

    Join? What are you joining? I understand you just want all rows ... add a null constant as suggested to step1 and simply link both of them to the next step. There is nothing to join, you just have two sources that you want to process as separate rows.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.