US and Worldwide: +1 (866) 660-7555
+ Reply to Thread
Results 1 to 5 of 5

Thread: update Error--help me

  1. 11-30-2007 12:36 AM #1
    dream8062
    dream8062 is offline Junior Member
    Join Date
    Jun 2007
    Posts
    12

    Question update Error--help me

    I run a transtermation with spoon 2.5,but I got a Error as follows:

    3:14:42,664 DEBUG [0] ??.0 - Values set for lookup: [id=2453], input row: [id=2453, balance=17100, new_balance=0, will_expire_balance=17100]
    13:14:42,665 DEBUG [0] ??.0 - Values set for lookup: [id=2454], input row: [id=2454, balance=24600, new_balance=0, will_expire_balance=24600]
    13:14:42,666 ERROR [0] ???.0 - Unexpected error in 'be.ibridge.kettle.core.exception.KettleDatabaseEx ception:
    Couldn't get row from result set
    Communications link failure due to underlying exception:

    ** BEGIN NESTED EXCEPTION **

    java.io.EOFException

    STACKTRACE:

    java.io.EOFException
    at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1913 )
    at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO. java:2357)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2803)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:812)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1295)
    at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDy namic.java:362)
    at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic. java:352)
    at com.mysql.jdbc.ResultSet.next(ResultSet.java:6691)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3054)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3036)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .processRow(TableInput.java:124)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:290)


    ** END NESTED EXCEPTION **



    Last packet sent to the server was 73773 ms ago.

    13:14:42,666 DEBUG [0] ??.0 - Values set for lookup: [id=2455], input row: [id=2455, balance=18700, new_balance=0, will_expire_balance=18700]
    13:14:42,667 ERROR [0] ???.0 - be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Couldn't get row from result set
    Communications link failure due to underlying exception:

    ** BEGIN NESTED EXCEPTION **

    java.io.EOFException

    STACKTRACE:

    java.io.EOFException
    at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1913 )
    at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO. java:2357)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2803)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:812)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1295)
    at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDy namic.java:362)
    at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic. java:352)
    at com.mysql.jdbc.ResultSet.next(ResultSet.java:6691)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3054)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3036)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .processRow(TableInput.java:124)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:290)


    ** END NESTED EXCEPTION **



    Last packet sent to the server was 73773 ms ago.

    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3112)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3036)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .processRow(TableInput.java:124)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:290)
    Caused by: com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

    ** BEGIN NESTED EXCEPTION **

    java.io.EOFException

    STACKTRACE:

    java.io.EOFException
    at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1913 )
    at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO. java:2357)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2803)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:812)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1295)
    at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDy namic.java:362)
    at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic. java:352)
    at com.mysql.jdbc.ResultSet.next(ResultSet.java:6691)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3054)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3036)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .processRow(TableInput.java:124)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:290)


    ** END NESTED EXCEPTION **



    Last packet sent to the server was 73773 ms ago.
    at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO. java:2515)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2803)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:812)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1295)
    at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDy namic.java:362)
    at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic. java:352)
    at com.mysql.jdbc.ResultSet.next(ResultSet.java:6691)
    at be.ibridge.kettle.core.database.Database.getRow(Da tabase.java:3054)
    ... 3 more

    13:14:42,668 DEBUG [0] ??.0 - Values set for lookup: [id=2456], input row: [id=2456, balance=9300, new_balance=0, will_expire_balance=9300]
    13:14:42,669 DEBUG [0] ??.0 - Values set for lookup: [id=2457], input row: [id=2457, balance=22100, new_balance=0, will_expire_balance=22100]
    13:14:42,670 DEBUG [0] ??.0 - Values set for lookup: [id=2458], input row: [id=2458, balance=18500, new_balance=0, will_expire_balance=18500]
    13:14:42,671 DEBUG [0] ??.0 - Values set for lookup: [id=2459], input row: [id=2459, balance=10300, new_balance=0, will_expire_balance=10300]
    13:14:42,672 DEBUG [0] ??.0 - Values set for lookup: [id=2460], input row: [id=2460, balance=10700, new_balance=0, will_expire_balance=10700]
    13:14:42,673 DEBUG [0] ??.0 - Values set for lookup: [id=2461], input row: [id=2461, balance=18900, new_balance=0, will_expire_balance=18900]
    13:14:42,673 DEBUG [0] ??.0 - Values set for lookup: [id=2462], input row: [id=2462, balance=12700, new_balance=0, will_expire_balance=12700]
    13:14:42,674 DEBUG [0] ??.0 - Values set for lookup: [id=2463], input row: [id=2463, balance=10900, new_balance=0, will_expire_balance=10900]
    13:14:42,675 DEBUG [0] ??.0 - Values set for lookup: [id=2464], input row: [id=2464, balance=18000, new_balance=0, will_expire_balance=18000]
    13:14:42,676 DEBUG [0] ??.0 - Values set for lookup: [id=2465], input row: [id=2465, balance=20100, new_balance=0, will_expire_balance=20100]
    13:14:42,690 ERROR [update_player_will_balance] update_player_will_balance - Errors detected!
    13:14:42,688 ERROR [update_player_will_balance] update_player_will_balance - Something went wrong while trying to stop the transformation: be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    13:14:42,701 ERROR [update_player_will_balance] update_player_will_balance - be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:545)
    at be.ibridge.kettle.core.database.Database.cancelQue ry(Database.java:524)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .stopRunning(TableInput.java:238)
    at be.ibridge.kettle.trans.Trans.stopAll(Trans.java:9 33)
    at be.ibridge.kettle.trans.step.BaseStep.stopAll(Base Step.java:1608)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:299)
    Caused by: java.sql.SQLException: Unknown thread id: 1002
    at com.mysql.jdbc.SQLError.createSQLException(SQLErro r.java:946)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2870)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:15 73)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java :1665)
    at com.mysql.jdbc.Connection.execSQL(Connection.java: 3176)
    at com.mysql.jdbc.PreparedStatement.executeInternal(P reparedStatement.java:1153)
    at com.mysql.jdbc.PreparedStatement.execute(PreparedS tatement.java:794)
    at com.mysql.jdbc.Statement.createResultSetUsingServe rFetch(Statement.java:505)
    at com.mysql.jdbc.Statement.execute(Statement.java:61 8)
    at com.mysql.jdbc.Statement.cancel(Statement.java:346 )
    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:539)
    ... 5 more

    13:14:42,701 INFO [0] ???.0 - Finished reading query, closing connection.
    13:14:42,710 DEBUG [0] Modified Java Script Value.0 - Stopped while putting a row on the buffer
    13:14:42,710 DEBUG [0] ???.0 - Stopped while putting a row on the buffer
    13:14:42,702 DEBUG [0] ??.0 - Values set for lookup: [id=2466], input row: [id=2466, balance=9400, new_balance=0, will_expire_balance=9400]
    13:14:42,720 ERROR [0] ???.0 - Unexpected error closing query : be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Couldn't close query: resultset or prepared statements
    Communications link failure due to underlying exception:

    ** BEGIN NESTED EXCEPTION **

    java.io.EOFException

    STACKTRACE:

    java.io.EOFException
    at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1913 )
    at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO. java:2304)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2803)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:812)
    at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1295)
    at com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDy namic.java:362)
    at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic. java:352)
    at com.mysql.jdbc.RowDataDynamic.close(RowDataDynamic .java:150)
    at com.mysql.jdbc.ResultSet.realClose(ResultSet.java: 7065)
    at com.mysql.jdbc.ResultSet.close(ResultSet.java:741)
    at be.ibridge.kettle.core.database.Database.closeQuer y(Database.java:2750)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .closePreviousQuery(TableInput.java:176)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .dispose(TableInput.java:217)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:303)


    ** END NESTED EXCEPTION **



    Last packet sent to the server was 73827 ms ago.

    13:14:42,726 INFO [biserver] biserver - Connection to database closed!
    13:14:42,726 INFO [biserver] biserver - Connection to database closed!
    13:14:42,754 INFO [update_player_will_balance] update_player_will_balance - Transformation detected 1 steps with errors!
    13:14:42,757 INFO [update_player_will_balance] update_player_will_balance - Transformation is killing the other steps!
    13:14:42,757 INFO [update_player_will_balance] update_player_will_balance - Looking at step: mod_date_fmt
    13:14:42,758 INFO [update_player_will_balance] update_player_will_balance - Looking at step: ???
    13:14:42,759 ERROR [update_player_will_balance] update_player_will_balance - Something went wrong while trying to stop the transformation: be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    13:14:42,760 ERROR [update_player_will_balance] update_player_will_balance - be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:545)
    at be.ibridge.kettle.core.database.Database.cancelQue ry(Database.java:524)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .stopRunning(TableInput.java:238)
    at be.ibridge.kettle.trans.Trans.stopAll(Trans.java:9 33)
    at be.ibridge.kettle.trans.step.BaseStep.stopAll(Base Step.java:1608)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .dispose(TableInput.java:223)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:303)
    Caused by: java.sql.SQLException: Unknown thread id: 1002
    at com.mysql.jdbc.SQLError.createSQLException(SQLErro r.java:946)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2870)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:15 73)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java :1665)
    at com.mysql.jdbc.Connection.execSQL(Connection.java: 3176)
    at com.mysql.jdbc.PreparedStatement.executeInternal(P reparedStatement.java:1153)
    at com.mysql.jdbc.PreparedStatement.execute(PreparedS tatement.java:794)
    at com.mysql.jdbc.Statement.createResultSetUsingServe rFetch(Statement.java:505)
    at com.mysql.jdbc.Statement.execute(Statement.java:61 8)
    at com.mysql.jdbc.Statement.cancel(Statement.java:346 )
    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:539)
    ... 6 more

    13:14:42,760 ERROR [biserver] biserver - Error disconnecting from database:
    Streaming result set com.mysql.jdbc.RowDataDynamic@1e0512a is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
    13:14:42,760 ERROR [biserver] biserver - java.sql.SQLException: Streaming result set com.mysql.jdbc.RowDataDynamic@1e0512a is still active. No statements may be issued when any streaming result sets are open and in use on a given connection. Ensure that you have called .close() on any active streaming result sets before attempting more queries.
    at com.mysql.jdbc.SQLError.createSQLException(SQLErro r.java:914)
    at com.mysql.jdbc.MysqlIO.checkForOutstandingStreamin gData(MysqlIO.java:2074)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:14 84)
    at com.mysql.jdbc.ServerPreparedStatement.realClose(S erverPreparedStatement.java:908)
    at com.mysql.jdbc.ServerPreparedStatement.close(Serve rPreparedStatement.java:476)
    at be.ibridge.kettle.core.database.Database.disconnec t(Database.java:432)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .dispose(TableInput.java:225)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .run(TableInput.java:303)

    13:14:42,761 INFO [0] ???.0 - Finished processing (I=5450, O=0, R=1, W=5449, U=0, E=1)
    13:14:42,746 ERROR [update_player_will_balance] update_player_will_balance - Something went wrong while trying to stop the transformation: be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    13:14:42,745 ERROR [update_player_will_balance] update_player_will_balance - Something went wrong while trying to stop the transformation: be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    13:14:42,762 ERROR [update_player_will_balance] update_player_will_balance - be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:545)
    at be.ibridge.kettle.core.database.Database.cancelQue ry(Database.java:524)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .stopRunning(TableInput.java:238)
    at be.ibridge.kettle.trans.Trans.stopAll(Trans.java:9 33)
    at be.ibridge.kettle.trans.step.BaseStep.stopAll(Base Step.java:1608)
    at be.ibridge.kettle.trans.step.BaseStep.putRow(BaseS tep.java:781)
    at be.ibridge.kettle.trans.step.calculator.Calculator .processRow(Calculator.java:66)
    at be.ibridge.kettle.trans.step.calculator.Calculator .run(Calculator.java:470)
    Caused by: java.sql.SQLException: Unknown thread id: 1002
    at com.mysql.jdbc.SQLError.createSQLException(SQLErro r.java:946)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2870)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:15 73)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java :1665)
    at com.mysql.jdbc.Connection.execSQL(Connection.java: 3176)
    at com.mysql.jdbc.PreparedStatement.executeInternal(P reparedStatement.java:1153)
    at com.mysql.jdbc.PreparedStatement.execute(PreparedS tatement.java:794)
    at com.mysql.jdbc.Statement.createResultSetUsingServe rFetch(Statement.java:505)
    at com.mysql.jdbc.Statement.execute(Statement.java:61 8)
    at com.mysql.jdbc.Statement.cancel(Statement.java:346 )
    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:539)
    ... 7 more

    13:14:42,762 ERROR [update_player_will_balance] update_player_will_balance - be.ibridge.kettle.core.exception.KettleDatabaseExc eption:
    Error cancelling statement
    Unknown thread id: 1002

    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:545)
    at be.ibridge.kettle.core.database.Database.cancelQue ry(Database.java:524)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .stopRunning(TableInput.java:238)
    at be.ibridge.kettle.trans.Trans.stopAll(Trans.java:9 33)
    at be.ibridge.kettle.trans.step.BaseStep.stopAll(Base Step.java:1608)
    at be.ibridge.kettle.trans.step.BaseStep.putRow(BaseS tep.java:781)
    at be.ibridge.kettle.trans.step.scriptvalues_mod.Scri ptValuesMod.processRow(ScriptValuesMod.java:486)
    at be.ibridge.kettle.trans.step.scriptvalues_mod.Scri ptValuesMod.run(ScriptValuesMod.java:544)
    Caused by: java.sql.SQLException: Unknown thread id: 1002
    at com.mysql.jdbc.SQLError.createSQLException(SQLErro r.java:946)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.ja va:2870)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:15 73)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java :1665)
    at com.mysql.jdbc.Connection.execSQL(Connection.java: 3176)
    at com.mysql.jdbc.PreparedStatement.executeInternal(P reparedStatement.java:1153)
    at com.mysql.jdbc.PreparedStatement.execute(PreparedS tatement.java:794)
    at com.mysql.jdbc.Statement.createResultSetUsingServe rFetch(Statement.java:505)
    at com.mysql.jdbc.Statement.execute(Statement.java:61 8)
    at com.mysql.jdbc.Statement.cancel(Statement.java:346 )
    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:539)
    ... 7 more

    13:14:42,763 INFO [0] ???.0 - Finished processing (I=0, O=0, R=4467, W=4466, U=0, E=0)
    13:14:42,755 INFO [0] ??.0 - Finished processing (I=2466, O=0, R=2466, W=0, U=0, E=0)
    13:14:42,765 INFO [0] Modified Java Script Value.0 - Finished processing (I=0, O=0, R=3466, W=3465, U=0, E=0)
    13:14:42,774 ERROR [update_player_will_balance] update_player_will_balance - Something went wrong while trying to stop the transformation: java.lang.NullPointerException
    13:14:42,774 ERROR [update_player_will_balance] update_player_will_balance - java.lang.NullPointerException
    at com.mysql.jdbc.Statement.cancel(Statement.java:346 )
    at be.ibridge.kettle.core.database.Database.cancelSta tement(Database.java:539)
    at be.ibridge.kettle.core.database.Database.cancelQue ry(Database.java:524)
    at be.ibridge.kettle.trans.step.tableinput.TableInput .stopRunning(TableInput.java:238)
    at be.ibridge.kettle.trans.Trans.stopAll(Trans.java:9 33)
    at be.ibridge.kettle.trans.step.BaseStep.stopAll(Base Step.java:1608)
    at be.ibridge.kettle.trans.Trans.killAll(Trans.java:7 93)
    at be.ibridge.kettle.trans.Trans.waitUntilFinished(Tr ans.java:719)
    at be.ibridge.kettle.pan.Pan.main(Pan.java:389)

    13:14:42,800 INFO [update_player_will_balance]
    Attached Files
    Reply With Quote Reply With Quote
  2. 11-30-2007 04:59 PM #2
    MattCasters
    MattCasters is offline Chief Data Integration
    Send a message via AIM to MattCasters Send a message via MSN to MattCasters Send a message via Yahoo to MattCasters Send a message via Skype™ to MattCasters
    Join Date
    Nov 1999
    Posts
    7,251

    Default

    It's a MySQL thing. Could it be a timeout that closes the connection or something like that?
    Google on it, there can be caused by a lot of things.

    Matt
    Matt Casters, Chief Data Integration
    Pentaho, Open Source Business Intelligence
    http://www.pentaho.org -- mcasters@pentaho.org

    Author of the upcoming book Pentaho Kettle Solutions by Wiley. Release date: mid-September 2010.

    Join us on IRC server Freenode.net, channel ##pentaho
    Reply With Quote Reply With Quote
  3. 12-09-2007 07:20 PM #3
    davemc
    davemc is offline Junior Member
    Join Date
    Jul 2007
    Posts
    18

    Default Timeout

    Yes it is a timeout that closes a connection.

    However the issue is that Kettle doesn't handle it correctly.

    We think it goes something like this....


    * Spoon or Kitchen start a long transform.
    * They open several connections to the database, and start processing.
    * Some of the steps are chugging away nicely through the data.
    * Other steps, or perhaps the repository connection, are idle, on seperate threads.
    * The chugger goes for 1.5 hours, and in our case looks like it has another 14 to go.
    * The database client/server decide one of the idle connections have been idle for long enough, and throw an exception.
    * Kettle sees the exception, and instead of saying, oh, that's ok, I have other threads that are busy, I'm just sitting here waiting for them to finish, so I can do some more, and I'll reconnect when I need to talk to the DB again, it passes the exception up the stack. This use case is mentioned several times in the mysql docs.

    This causes the whole transform to go BANG, and breaks it.

    This effectively means you can't do any transform longer than 1.5 hours against MySQL.

    There must be a way to configure this correctly, but I'm not sure what it is yet, and perhaps some Kettle experts can assist.
    Reply With Quote Reply With Quote
  4. 12-10-2007 02:26 AM #4
    sboden
    sboden is offline Senior Member
    Join Date
    May 2006
    Posts
    4,882

    Default

    Reconnection is not really an option as that would make transaction management very very messy. There's somewhere a switch on MySQL to increase timeouts, but I'm not the MySQL expert.

    Regards,
    Sven
    Reply With Quote Reply With Quote
  5. 12-10-2007 07:58 AM #5
    MattCasters
    MattCasters is offline Chief Data Integration
    Send a message via AIM to MattCasters Send a message via MSN to MattCasters Send a message via Yahoo to MattCasters Send a message via Skype™ to MattCasters
    Join Date
    Nov 1999
    Posts
    7,251

    Default

    In the database dialog there is an Options tab.
    In the options tab there is a "help" button somewhere.
    Click on it and it will open the JDBC options page from the MySQL website.

    Then you can figure out which option it is, I have to say I completely forgot which one it is.
    However, there are not *that* many timeout options.

    Matt
    Matt Casters, Chief Data Integration
    Pentaho, Open Source Business Intelligence
    http://www.pentaho.org -- mcasters@pentaho.org

    Author of the upcoming book Pentaho Kettle Solutions by Wiley. Release date: mid-September 2010.

    Join us on IRC server Freenode.net, channel ##pentaho
    Reply With Quote Reply With Quote
+ Reply to Thread
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Forum Rules