Hitachi Vantara Pentaho Community Forums
Results 1 to 7 of 7

Thread: Change Data Capture

  1. #1

    Default Change Data Capture

    Can we use PDI to extract the Changed Data ?

    we are supporting both MSSQL and Oracle, and we want to know the better way for the CDC subsystem.

    So we want to know if PDI is capable of supporting one of the folowing CDC technique

    - Using Audit Column
    - Database Log Scraping or Sniffing
    - Time Extracts
    - Process of Elimination (prefered method ?)
    - Initial and Incremental Loads

    All the above technique comes from the DW ETL Toolkit.

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    All except "Database Log Scraping or Sniffing"

  3. #3

    Default

    Thanks

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Plug: read more about it in our upcoming book: Pentaho Kettle Solutions.

  5. #5
    Join Date
    Mar 2010
    Posts
    159

    Default

    It feels like the book release is converging with 4.1 release... is this about right?

  6. #6
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Not really, 4.1 will be released when it's done. The book however is on a tight schedule and took over 9 months to create.

  7. #7

    Default

    here is a plugin named Change Data Extract

    http://www.xgndata.com/resources/kettle/plugin_CDE.zip

    this plugin can extract change data from a table by a trigger and a shadow table;
    Jason chu
    Beijing Aofei BI Consulting.
    Web: http://www.pentahochina.com
    Email: jianjunchu@gmail.com

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.