Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: issue regarding scd 1

  1. #1
    Join Date
    Mar 2007
    Posts
    158

    Default issue regarding scd 1

    while loading the data into the target dimension, i want to implement
    scd type 1, regarding this i have the following doubt:
    i am having a column as the natural key in my dimension table, based on
    which i can find out whether the record exists or not in the target.

    if the record doesnt exist, i will insert, else i will update,
    my question is, if the record exists in the target, and no changes were made
    in the oltp, is there a need to update the record?

    Will anyone please clarify on this? Also i have multiple sources as
    input, (oracle,xml etc), i want to know whether lookup is capable of
    handling all these sources....
    and what if multiple users load data from multiple sources at the same
    time? then how to handle the insert or update issue here?

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    if the record doesnt exist, i will insert, else i will update,
    my question is, if the record exists in the target, and no changes were made
    in the oltp, is there a need to update the record?
    Obviously not, our implementation (Dimension Lookup/Update) does not update in that case.

    Also i have multiple sources as input, (oracle,xml etc), i want to know whether lookup is capable of handling all these sources....
    Yes, you can use the "Stream Lookup" step to do in-memory lookups after reading from XML/CSV/XLS/...

    and what if multiple users load data from multiple sources at the same
    time? then how to handle the insert or update issue here?
    I would recommend to keep it sane by not allowing any user to load data in the warehouse. <cough>

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.