Six Stars

talendStats_DB - Closed Connection

Hello

can anyone help please

when i run a job for hours , if returns failed with

 

Closed Connection
[ERROR]: sandbox_leapoc_project.jobconductor_prismbb_0_1.JOBCONDUCTOR_PRISMBB - talendStats_DB - Closed Connection

 

what could be closing the connection

 

thanks for your help

7 REPLIES
Highlighted
Moderator

Re: talendStats_DB - Closed Connection

Hello,

Would you mind posting your current job design screenshots on forum which will be helpful for us to address your issue?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: talendStats_DB - Closed Connection

Hi

 

I have attached it to this post

 

regards

Buks

Moderator

Re: talendStats_DB - Closed Connection

Hello,

Have you tried to check out "Die on error" option to see if there is any more error message printed on console?

1.png

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: talendStats_DB - Closed Connection

I checked out Die on error and below are the errors i got.

 

Starting job FW_GZ_HDFS_ORACLE at 09:07 03/09/2017.

[statistics] connecting to socket on port 3635
[statistics] connected
[WARN ]: org.apache.hadoop.io.compress.zlib.ZlibFactory - Failed to load/initialize native-zlib library
[FATAL]: sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE - tOracleOutput_1 IO Error: Connection reset
caused by: IO Error: Connection reset
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
    at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
    at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
    at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
    ... 2 more
Caused by: java.net.SocketException: Connection reset
    at java.net.SocketInputStream.read(SocketInputStream.java:210)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at oracle.net.ns.Packet.receive(Packet.java:311)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
    at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
    ... 6 more
Exception in component tOracleOutput_1 (FW_GZ_HDFS_ORACLE)
java.sql.SQLException: IO Error: Connection reset
caused by: IO Error: Connection reset
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2479)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.runJobInTOS(FW_GZ_HDFS_ORACLE.java:6529)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.main(FW_GZ_HDFS_ORACLE.java:6335)
Caused by: java.sql.SQLRecoverableException: IO Error: Connection reset
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:967)
    at oracle.jdbc.driver.OraclePreparedStatement.executeForRowsWithTimeout(OraclePreparedStatement.java:10932)
    at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11043)
    at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244)
    at sandbox_leapoc_project.fw_gz_hdfs_oracle_0_1.FW_GZ_HDFS_ORACLE.tHDFSInput_1Process(FW_GZ_HDFS_ORACLE.java:2466)
    ... 2 more
Caused by: java.net.SocketException: Connection reset
    at java.net.SocketInputStream.read(SocketInputStream.java:210)
    at java.net.SocketInputStream.read(SocketInputStream.java:141)
    at oracle.net.ns.Packet.receive(Packet.java:311)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
    at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
    ... 6 more
[statistics] disconnected
Job FW_GZ_HDFS_ORACLE ended at 10:01 03/09/2017. [exit code=1]

Moderator

Re: talendStats_DB - Closed Connection

Hello,

Could you please try to use this solution to see if it works?

In tPreJob use Oracle connection component and enable autocommit. Set use connection option in tOracleOutput and check again.

tpreJob-->tOracleConnection

                   | on subjobOk

Input source -> tmap -> toracleoutput

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: talendStats_DB - Closed Connection

Hi Sabrina

 

it runs but extremely very slow and at some stage it paused/stopped for about 10mins and could not wait so i killed the job

is it expected to pause or wait like that .

can you please  explain what is going on in the background with the tOracleConnection while its waiting and what do we achieve with

tpreJob-->tOracleConnection

                   | on subjobOk

 

any reasons why its very slow

 

thanks

Buks

Moderator

Re: talendStats_DB - Closed Connection

Hi,

Performance issue is usually cause by the DB connection or the job design.

Are you using talend subscription solution? From your screenshot, we see that there is "jobscript" feature in your studio.

If so, it is recommended that you should create a case on talend support portal. In this way, we can give you a remote assistance(webex) through support cycle with priority.

https://login.talend.com/support-login.php.

 

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.