Hitachi Vantara Pentaho Community Forums
Results 1 to 4 of 4

Thread: migrating from custom etl-tool to kettle - how?

  1. #1
    Join Date
    Aug 2007
    Posts
    5

    Question migrating from custom etl-tool to kettle - how?

    Hi

    I'd like to know how i can migrate from my company's self-developed etl-tool to kettle. The problem was already briefly discussed here:

    http://forums.pentaho.org/showthread.php?t=55773

    As our self-developed tool is not only used in our own company but in other (client-)environments as well, it would be nice to automate things at least a bit, because redevelop everything in every environment would be a cumbersome task.

    My idea is to program my own "company-etl 2 kettle" converter, creating .kjb and .ktr files to be imported in the destination kettle-environment.

    Unfortunately, the .kjb and .ktr files (being xml) are not well defined:
    http://forums.pentaho.org/showthread.php?t=55227

    My question is: Does somebody has any better ideas?

    Thanks in advance!

    musikdusche

  2. #2
    Join Date
    May 2006
    Posts
    4,882

    Default

    well... I tried for http://www-306.ibm.com/software/data...US/sw-library/ but it's also not working.

    Main problem being that all ETL tools are different and it's very hard to get a 100% 1 to 1 mapping of jobs. They are all very good at locking in companies.

    There are some cases where I could do it (for the above)... I used to write all my jobs as big input query/transformer/output but you will never get anything that automatically converts jobs.


    OF COURSE, if it's your own tool you could adapt your job definition to be more PDI-compliant: loading your job definition in a java program, deciding what is needed, defining all components in Kettle via java and then writing the output definition in PDI. Have a look e.g. at the unit test cases in SVN (under test).

    Regards,
    Sven

  3. #3
    Join Date
    Aug 2007
    Posts
    5

    Default

    Thanks for the quick answer. I'll have a look in SVN.

    Regards

    Musikdusche

  4. #4
    Join Date
    May 2006
    Posts
    4,882

    Default

    It's just a way of building transformations using java components directly... If you have some kind of method/application to load your own ETL's and you can make a mapping from yours to PDI's you would be able to get pretty far (never 100% probably).

    It will mostly depend on what "exotic" stuff your tool does

    Sven

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.