Hitachi Vantara Pentaho Community Forums
Results 1 to 2 of 2

Thread: Loads incremental data from a table of one database to table of another

  1. #1
    Join Date
    May 2010
    Posts
    133

    Default Loads incremental data from a table of one database to table of another

    I have been using Pentaho PDI 4.2.1 .
    The project demands incremental data loading from Oracle database to PostgreSQL database owing to its size.
    Does anybody has a proven solution that loads incremental data from a table of one database to table of another?
    In a nutshell, since PDI does not support simultaneous connections to across RDBMS products in a single transformation, I am looking for the correct usage of set and get variables steps to achieve this.

  2. #2
    Join Date
    Nov 1999
    Posts
    9,727

    Default

    Incremental load can be done using CDC, for example if you have a time-stamp in the source table.
    And yes, you can make a transformation database transactional on all used databases.
    Matt Casters, Chief Data Integration
    Pentaho, Open Source Business Intelligence
    http://www.pentaho.org -- mcasters@pentaho.org

    Author of the book Pentaho Kettle Solutions by Wiley. Also available as e-Book and on the Kindle reading applications (iPhone, iPad, Android, Kindle devices, ...)

    Join us on IRC server Freenode.net, channel ##pentaho

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.