Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: Kettle for integration

  1. #1
    Join Date
    Apr 2006
    Posts
    3

    Default Kettle for integration

    Matt,
    I need an integration tool to syncronize data online. For this I need it to process rows for Insert, update and delete operations.
    ¿Have you done something like this before? ¿do you have any thoughts on supporting this type of input output native in Kettle?

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default RE: Kettle for integration

    Please search the forum for similar answers to these kind of questions.

    Thanks,
    Matt

  3. #3
    Join Date
    Apr 2006
    Posts
    3

    Default RE: Kettle for integration

    I did. I'll get the delete step. I already made a program to create a automatically a journal for the tables I'm interested by triggering.
    In Kettle I would have to use a field on each row to indicate wether its an Insert, Update or Delete and send some rows to the insert/update step and others to the Delete step.
    This I would have to do for each table I want to replicate on-line, so instead of making this transformation for each table I imagine a step that did it alltoguether and decided to insert or delete depending on the value of one field of the Row, maybe run some JS.
    ¿Has anyone thought of a better solution?

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default RE: Kettle for integration

    Hi Merayo,

    If you already have the flag on the record from your trigger, then you can just put a filter on that and send the records to either a Delete or an Insert/Update step depending on the flag.
    That is only 3 steps with the advantage that the filter condition can be just about anything.
    IMHO it doesn't really warrant *another* new step that has to be maintained independently.

    Do let me know if this works for you or if you run into trouble. There are many people facing this issue so I want to make sure we get this to work.

    On a higher level (as a BI person) of-course I have to wonder if people are not using this to secretely create an evil ODS to report on. :-(

    Thanks,
    Matt

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.