Hitachi Vantara Pentaho Community Forums
Results 1 to 6 of 6

Thread: Problem with kettle performance when using select after insert in mysql

  1. #1
    Join Date
    Oct 2013
    Posts
    216

    Post Problem with kettle performance when using select after insert in mysql

    HI ,

    I created one procedure in mysql that insert data into two tables by using join of several tables .

    In Kettle I am calling that procedure so data are migrated . This is done properly.

    Now I created another JOB that uses select query on this all tables .

    If I Run this second job it execute in 2 minutes.

    but when I run first job and then running second it is going into infinite time .

    Does anyone help me to solve it out ?

    Thanks in advance !!

  2. #2

    Default

    Looks to me that the 2nd scenario is essentially similar to the first. The jobs are started sequentially ? I mean, you start the select AFTER the insert is done?

  3. #3
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    Post your jobs, and we'll see what we can do to fix it.
    **THIS IS A SIGNATURE - IT GETS POSTED ON (ALMOST) EVERY POST**
    I'm no expert.
    Take my comments at your own risk.

    PDI user since PDI 3.1
    PDI on Windows 7 & Linux

    Please keep in mind (and this may not apply to this thread):
    No forum member is going to do your work for you. We will help you sort out how to do a specific part of the work, as best we can, in the timelines that our work will allow us.
    Signature Updated: 2014-06-30

  4. #4
    Join Date
    Oct 2013
    Posts
    216

    Default

    Yes, First I insert into tables and then i used select on that. I have a gap of 3 hours between that . Is there any problems related to indexes ??

  5. #5
    Join Date
    Apr 2008
    Posts
    4,696

    Default

    I'll repeat myself...

    Quote Originally Posted by gutlez View Post
    Post your jobs, and we'll see what we can do to fix it.
    Post your jobs and transforms, and we'll see what we can do to fix it.
    **THIS IS A SIGNATURE - IT GETS POSTED ON (ALMOST) EVERY POST**
    I'm no expert.
    Take my comments at your own risk.

    PDI user since PDI 3.1
    PDI on Windows 7 & Linux

    Please keep in mind (and this may not apply to this thread):
    No forum member is going to do your work for you. We will help you sort out how to do a specific part of the work, as best we can, in the timelines that our work will allow us.
    Signature Updated: 2014-06-30

  6. #6
    Join Date
    Oct 2013
    Posts
    216

    Default

    Thanks , My problem is solved by using Optimize table after insertion into that table.
    I added this command into procedure and all things works well.

    http://dev.mysql.com/doc/refman/5.7/...ize-table.html


Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2019 Hitachi Vantara Corporation. All Rights Reserved.