Hitachi Vantara Pentaho Community Forums
Results 1 to 3 of 3

Thread: Multiple Input Streams to Select

  1. #1
    Join Date
    Nov 2006
    Posts
    26

    Default Multiple Input Streams to Select

    Are there any design concerns when 4 independent source system streams feed into a SELECT operator? The structures of each input stream to the SELECT operator are identical (name and data type). The ETL of each input stream differs because each source system may/may not have the same column. Missing columns are added as constants.

    Thanks

    Ed

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    Well all hops (except for the yellow hops) flowing into 1 step need to be of the same structure, so you will need extra select value steps probably (1 per different source system).

    Regards,
    Sven

  3. #3
    Join Date
    Nov 2006
    Posts
    26

    Default

    Thanks,

    We do have that implementation. I was concerned about cpu/memory bottle knecks. We are running our ETL jobs on a Windows NT virtual server with 2 cpu's and 2gb memory


    Ed

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.