Hitachi Vantara Pentaho Community Forums
Results 1 to 5 of 5

Thread: Table Output step - Connection problem

  1. #1
    Join Date
    Apr 2013
    Posts
    5

    Default Table Output step - Connection problem

    Hi,

    I'm remotely running a transformation using pan.sh, but when the transformation start to execute the table output step (to a MySql table) I'm getting a connection error. I've tested the connection successfully, the transformation was running normally until 2 days ago and no changes were made to it in 5 days.

    Log:

    Code:
    NFO  13-05 13:16:04,978 - Merge Join - Finished processing (I=0, O=0, R=14112, W=9626, U=0, E=0)
    INFO  13-05 13:16:04,988 - If field value is null - Finished processing (I=0, O=0, R=9626, W=9626, U=0, E=0)
    ERROR 13-05 13:16:05,639 - Table output - Unexpected error committing the database connection.
    ERROR 13-05 13:16:05,640 - Table output - org.pentaho.di.core.exception.KettleDatabaseException: 
    Error comitting connection
    
    
    Unable to get database metadata from this database connection
    No operations allowed after connection closed.
    
    
    
    
    	at org.pentaho.di.core.database.Database.commit(Database.java:707)
    	at org.pentaho.di.core.database.Database.commit(Database.java:676)
    	at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1492)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:658)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:79)
    	at java.lang.Thread.run(Thread.java:722)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 
    Unable to get database metadata from this database connection
    No operations allowed after connection closed.
    
    
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3105)
    	at org.pentaho.di.core.database.Database.commit(Database.java:693)
    	... 5 more
    Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
    	at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.Util.getInstance(Util.java:386)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1015)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:975)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:920)
    	at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1304)
    	at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1296)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3236)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3231)
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3101)
    	... 6 more
    Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
    
    
    The last packet successfully received from the server was 126,422 milliseconds ago.  The last packet sent successfully to the server was 28 milliseconds ago.
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1121)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3871)
    	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2484)
    	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2664)
    	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2815)
    	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359)
    	at org.pentaho.di.core.database.Database.insertRow(Database.java:1360)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:284)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:128)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
    	... 1 more
    Caused by: java.net.SocketException: Broken pipe
    	at java.net.SocketOutputStream.socketWrite0(Native Method)
    	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
    	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
    	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3852)
    	... 12 more
    
    
    ERROR 13-05 13:16:05,641 - Table output - org.pentaho.di.core.exception.KettleDatabaseException: 
    Error comitting connection
    
    
    Unable to get database metadata from this database connection
    No operations allowed after connection closed.
    
    
    
    
    	at org.pentaho.di.core.database.Database.commit(Database.java:707)
    	at org.pentaho.di.core.database.Database.commit(Database.java:676)
    	at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1492)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:658)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:79)
    	at java.lang.Thread.run(Thread.java:722)
    Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 
    Unable to get database metadata from this database connection
    No operations allowed after connection closed.
    
    
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3105)
    	at org.pentaho.di.core.database.Database.commit(Database.java:693)
    	... 5 more
    Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
    	at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.Util.getInstance(Util.java:386)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1015)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:975)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:920)
    	at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1304)
    	at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1296)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3236)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3231)
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3101)
    	... 6 more
    Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
    
    
    The last packet successfully received from the server was 126,422 milliseconds ago.  The last packet sent successfully to the server was 28 milliseconds ago.
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1121)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3871)
    	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2484)
    	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2664)
    	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2815)
    	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359)
    	at org.pentaho.di.core.database.Database.insertRow(Database.java:1360)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:284)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:128)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
    	... 1 more
    Caused by: java.net.SocketException: Broken pipe
    	at java.net.SocketOutputStream.socketWrite0(Native Method)
    	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
    	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
    	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3852)
    	... 12 more
    
    
    ERROR 13-05 13:16:05,642 - Table output - Unexpected error rolling back the database connection.
    ERROR 13-05 13:16:05,642 - Table output - org.pentaho.di.core.exception.KettleDatabaseException: 
    Unable to get database metadata from this database connection
    No operations allowed after connection closed.
    
    
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3105)
    	at org.pentaho.di.core.database.Database.rollback(Database.java:724)
    	at org.pentaho.di.core.database.Database.rollback(Database.java:713)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:708)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:79)
    	at java.lang.Thread.run(Thread.java:722)
    Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
    	at sun.reflect.GeneratedConstructorAccessor8.newInstance(Unknown Source)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.Util.getInstance(Util.java:386)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1015)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:975)
    	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:920)
    	at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1304)
    	at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1296)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3236)
    	at com.mysql.jdbc.ConnectionImpl.getMetaData(ConnectionImpl.java:3231)
    	at org.pentaho.di.core.database.Database.getDatabaseMetaData(Database.java:3101)
    	... 5 more
    Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
    
    
    The last packet successfully received from the server was 126,422 milliseconds ago.  The last packet sent successfully to the server was 28 milliseconds ago.
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
    	at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
    	at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1121)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3871)
    	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2484)
    	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2664)
    	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2815)
    	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2458)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2375)
    	at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2359)
    	at org.pentaho.di.core.database.Database.insertRow(Database.java:1360)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:284)
    	at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:128)
    	at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50)
    	... 1 more
    Caused by: java.net.SocketException: Broken pipe
    	at java.net.SocketOutputStream.socketWrite0(Native Method)
    	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
    	at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
    	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
    	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
    	at com.mysql.jdbc.MysqlIO.send(MysqlIO.java:3852)
    	... 12 more
    
    
    INFO  13-05 13:16:05,643 - Table output - Finished processing (I=0, O=9626, R=9626, W=9626, U=0, E=1)
    INFO  13-05 13:16:05,643 - Pan - Finished!
    INFO  13-05 13:16:05,644 - Pan - Start=2013/05/13 13:13:55.960, Stop=2013/05/13 13:16:05.643
    INFO  13-05 13:16:05,644 - Pan - Processing ended after 2 minutes and 9 seconds (129 seconds total).
    log4j:WARN No appenders could be found for logger (org.pentaho.di).
    log4j:WARN Please initialize the log4j system properly.
    Another error line:

    Code:
    WARNING: Couldn't insert row into table: ROW DATA (hidden)
    
    
    Error inserting/updating row
    Communications link failure
    
    
    The last packet successfully received from the server was 126,422 milliseconds ago.  The last packet sent successfully to the server was 28 milliseconds ago.
    
    
    INFO  13-05 13:16:04,679 - Table output - WARNING: Couldn't insert row into table: ROW DATA (hidden)
    
    
    offending row : Row Schema
    
    
    Error setting value #1 [firstname String] on prepared statement (String)
    com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after statement closed.
    No operations allowed after statement closed.
    I think that the second error occurs because the connection was closed already.

    Can someone help me with this?

    Thanks!

  2. #2
    Join Date
    Jun 2012
    Posts
    5,524

    Default

    The last packet successfully received from the server was 126,422 milliseconds ago. The last packet sent successfully to the server was 28 milliseconds ago.
    Check this out: http://wiki.pentaho.com/display/EAI/MySQL
    pdi-ce user (mostly 4.4)
    java 1.8.0_131 (OpenJDK)
    ubuntu 16.04 LTS (x86_64)
    timezone CET / CEST
    contemplative reading SSCCE
    sig updated 2017-10-20

  3. #3
    Join Date
    Apr 2013
    Posts
    5

    Default

    Quote Originally Posted by marabu View Post
    Checked the link you sent, but cant use the proposed solution. The database is located on a cloud server and there's no way to change user privileges to super or how to access my.cnf file to set net_write_timeout value. There's a way to awake the connection on my transformation?
    Also, when I try to add connection parameters on my connection using through Bi Server, none of the changes seems to have effect/be saved.

    Thx again!

    Another info: We create the transformation on a local machine then we send the file to the server to run with pan.

  4. #4

    Default

    Any workaround of this problem

    I have exactly the same problem, and I can't modify server settings because is on the cloud.

    I had tested every parameter about the jdbc controller but failed.

    Thanks in advance.

  5. #5
    Join Date
    Jan 2013
    Posts
    4

    Default

    Edit the connection → Advanced → SQL statements:
    Code:
    SET SESSION wait_timeout = 600;
    This sets the number of seconds before server closes an inactive connection. http://dev.mysql.com/doc/en/server-s...r_wait_timeout

    Many configuration variables can be assigned by the client this way. http://dev.mysql.com/doc/en/set-statement.html

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Privacy Policy | Legal Notices | Safe Harbor Privacy Policy

Copyright © 2005 - 2017 Pentaho Corporation. All Rights Reserved.