Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Transactional execution with Kettle 4.4.2

  1. #1
    Join Date
    Dec 2015
    Posts
    3

    Unhappy Transactional execution with Kettle 4.4.2

    Hi Guys,

    I've created a job that extracts data from several tables in an Oracle DB and loads it in another Oracle DB.
    Table definition source/target is 1:1.
    Job contains:
    - one transformation with an 'Add constant rows' step to set table names to load data from and into and a 'Coy rows to result step'
    - one job that executes for every input row and has:
    - one 'Set variabes' step to set current table name
    - one generic transformation to extract and load data that contains:
    - one table input step with SELECT * from ${current_table} executed on source connection
    - one table output step with Target table set as ${current_table} executed on destination connection

    The question is if there is way to ensure that if data loading fails for one of the tables, changes for all tables will be rolled back?

    From my testing, the 'Make database transactional' transformation option would helphere only if input/output steps for all (around 30) tables would be in the same transaction.

    OR maybe there is another job design more adequate for this case?

    Thanks in advance.
    Larisa.

  2. #2
    Join Date
    Jun 2012
    Posts
    5,534

    Default

    Too bad for you that only from version 5 up all your transformations share the same database session - see Transactions in jobs.

    Are you sure you can't upgrade?
    So long, and thanks for all the fish.

  3. #3
    Join Date
    Dec 2015
    Posts
    3

    Default

    Yes, I know about Job transactions added in version 5, but there is no way to upgrade since it's an enterprise environment .
    Is there really no other possibility?

    Thanks.

  4. #4
    Join Date
    Aug 2011
    Posts
    360

    Default

    Quote Originally Posted by Larisa View Post
    Yes, I know about Job transactions added in version 5, but there is no way to upgrade since it's an enterprise environment .
    Is there really no other possibility?

    Thanks.
    Just as a side note: you should really start thinking of planning an upgrade!
    At works we didn't took time to plan an upgrade, because of intensive production.
    We tried many times but it was more on off-times than on regular work. So we end up this year to finally upgrade
    from 3.2 to 5.4......and this was kind of work! (Ok we were also setting up three nee environnment)
    Since version 6 is out know, you should really push your enterprise to plan and take time to upgrade your softwares
    unless you end up with big jumps and problems.

    However, in general PDI is fully conpatible with oldee version, so you can just install knew version, export old repository to XML
    and import in new version.

  5. #5
    Join Date
    Dec 2015
    Posts
    3

    Default

    Thanks for your advice.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.