Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Databases join tool optimization

  1. #1

    Default Databases join tool optimization

    Hi,


    I am designing transformation using kettle-240, in that I am using sql DB Script to retrieve data from 6 different tables by doing left outer join in database join tool. This is taking long time to give output, please give me a good solution for optimizing database join tool .

    The script checked in db is giving output in a fraction of seconds.

    Thanks and waiting for a kind solution



    Regards
    Vijay

  2. #2
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    Vijay, if it's very fast on the database, why don't you do it on the database?

    The point of the database join is to have the option to join with different databases.
    If you can do it with a simple SQL query, you should do it so.

    Trust me, SQL is not that hard to learn.

    Matt

  3. #3

    Default

    Hi,

    I have to use kettle transformation (instead of database) why because retrieving report is not only from database tables but also from xls, CSV files. In that database join tool is taking more time to give output, so please give me solution to optimize kettle database join tool with sample transformation



    Thanks and regards
    Vijay

  4. #4
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    It doesn't make any sense to "Database Join" with an excel or a text file.

    If you load the excel and text-files into a database table first, consider that using the "Merge Join" step directly might be a heck of a lot faster.

    Matt

  5. #5
    Join Date
    Nov 1999
    Posts
    9,729

    Default

    You would have to upgrade to 2.5 or 3.0 for that one though ;-)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.