[resolved] Error with Stats Log when moving from Mysql5.0 to Mysql 5.1

One Star

[resolved] Error with Stats Log when moving from Mysql5.0 to Mysql 5.1

Hi,
I have the following error since I moved a job from a Mysql 5.0 to Mysql 5.1...
I do not understand what happen because I have 3 similar jobs in another. I am not even sure that the Mysql 5.1 is an issue.
I have check every components. All connections are ok.
This job is a Sub Job of a main scheduler (MAIN_AGG). The main scheduler includes TstatsCatcher/LOgCatcher and Flow catcher...
All other sub jobs of the main scheduler work perfectly with stats. (tRunJob_2Process and tRunJob_1Process generate correctly statistics...)

Exception in component connectionStatsLogs
com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:
java.net.SocketException: java.net.ConnectException: Connection timed out
at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156)
at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:284)
at com.mysql.jdbc.Connection.createNewIO(Connection.java:2569)
at com.mysql.jdbc.Connection.<init>(Connection.java:1485)
at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:185)
at routines.system.SharedDBConnection.getConnection(SharedDBConnection.java:63)
at routines.system.SharedDBConnection.getDBConnection(SharedDBConnection.java:95)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.connectionStatsLogsProcess(ADAP_03_table_fait.java:9964)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.preStaLogConProcess(ADAP_03_table_fait.java:1137)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJobInTOS(ADAP_03_table_fait.java:13138)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJob(ADAP_03_table_fait.java:12826)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_3Process(MAIN_06_ADAP.java:1516)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_2Process(MAIN_06_ADAP.java:1420)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_1Process(MAIN_06_ADAP.java:1276)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJobInTOS(MAIN_06_ADAP.java:1966)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJob(MAIN_06_ADAP.java:1855)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_3Process(MAIN_AGG.java:1334)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_2Process(MAIN_AGG.java:1205)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_1Process(MAIN_AGG.java:810)
at AGG_etl.main_AGG_0_1.MAIN_AGG.runJobInTOS(MAIN_AGG.java:4918)
at AGG_etl.main_AGG_0_1.MAIN_AGG.main(MAIN_AGG.java:4624)

** END NESTED EXCEPTION **

Last packet sent to the server was 0 ms ago.
at com.mysql.jdbc.Connection.createNewIO(Connection.java:2643)
at com.mysql.jdbc.Connection.<init>(Connection.java:1485)
at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:185)
at routines.system.SharedDBConnection.getConnection(SharedDBConnection.java:63)
at routines.system.SharedDBConnection.getDBConnection(SharedDBConnection.java:95)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.connectionStatsLogsProcess(ADAP_03_table_fait.java:9964)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.preStaLogConProcess(ADAP_03_table_fait.java:1137)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJobInTOS(ADAP_03_table_fait.java:13138)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJob(ADAP_03_table_fait.java:12826)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_3Process(MAIN_06_ADAP.java:1516)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_2Process(MAIN_06_ADAP.java:1420)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_1Process(MAIN_06_ADAP.java:1276)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJobInTOS(MAIN_06_ADAP.java:1966)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJob(MAIN_06_ADAP.java:1855)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_3Process(MAIN_AGG.java:1334)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_2Process(MAIN_AGG.java:1205)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_1Process(MAIN_AGG.java:810)
at AGG_etl.main_AGG_0_1.MAIN_AGG.runJobInTOS(MAIN_AGG.java:4918)
at AGG_etl.main_AGG_0_1.MAIN_AGG.main(MAIN_AGG.java:4624)
Exception in component talendStats_DB
java.lang.NullPointerException
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.talendStats_STATSProcess(ADAP_03_table_fait.java:11503)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJobInTOS(ADAP_03_table_fait.java:13160)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJob(ADAP_03_table_fait.java:12826)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_3Process(MAIN_06_ADAP.java:1516)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_2Process(MAIN_06_ADAP.java:1420)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_1Process(MAIN_06_ADAP.java:1276)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJobInTOS(MAIN_06_ADAP.java:1966)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJob(MAIN_06_ADAP.java:1855)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_3Process(MAIN_AGG.java:1334)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_2Process(MAIN_AGG.java:1205)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_1Process(MAIN_AGG.java:810)
at AGG_etl.main_AGG_0_1.MAIN_AGG.runJobInTOS(MAIN_AGG.java:4918)
at AGG_etl.main_AGG_0_1.MAIN_AGG.main(MAIN_AGG.java:4624)
Exception in component talendStats_DB
java.lang.NullPointerException
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.talendStats_STATSProcess(ADAP_03_table_fait.java:11503)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJobInTOS(ADAP_03_table_fait.java:13197)
at AGG_etl.adap_03_table_fait_0_1.ADAP_03_table_fait.runJob(ADAP_03_table_fait.java:12826)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_3Process(MAIN_06_ADAP.java:1516)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_2Process(MAIN_06_ADAP.java:1420)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.tRunJob_1Process(MAIN_06_ADAP.java:1276)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJobInTOS(MAIN_06_ADAP.java:1966)
at AGG_etl.main_06_adap_0_1.MAIN_06_ADAP.runJob(MAIN_06_ADAP.java:1855)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_3Process(MAIN_AGG.java:1334)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_2Process(MAIN_AGG.java:1205)
at AGG_etl.main_AGG_0_1.MAIN_AGG.tRunJob_1Process(MAIN_AGG.java:810)
at AGG_etl.main_AGG_0_1.MAIN_AGG.runJobInTOS(MAIN_AGG.java:4918)
at AGG_etl.main_AGG_0_1.MAIN_AGG.main(MAIN_AGG.java:4624)

Do you have any idea how I can solve it ?
Thanks

Accepted Solutions
One Star

Re: [resolved] Error with Stats Log when moving from Mysql5.0 to Mysql 5.1

Thanks you very much. It works.
I was Using talend TOS 4.03 buil 47759. I am updating to 4.1.
If it helps you to find why this bug still exists, here is the how I did (it is pretty hard to remember accurately, but I think it is correct) :
1 - All my sub jobs included the 3 stats/logs/flow objets and a mysqlouput to DB.
2 - I removed in all my subjobs the 3 (objets -> mylsqoutput)
3 - I changed information in the referentiel (db host)
4 - I added uniques 3 (components -> mysqloutput) in my main scheduler
then the bug happens.
2 subjobs of the main scheduler are not impacted.
The third one (last one also) was bugging.

Regards

View solution in original post


All Replies
Community Manager

Re: [resolved] Error with Stats Log when moving from Mysql5.0 to Mysql 5.1

Hello
Which version of TIS/TOS are you using? It was a bug and have been fixed, if you are using TIS, you can report a support ticket and ask for a patch. Right now, you have to go to job setting tab-->Stats & logs and see if the db connection parameters are correct, especially the db version.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: [resolved] Error with Stats Log when moving from Mysql5.0 to Mysql 5.1

Thanks you very much. It works.
I was Using talend TOS 4.03 buil 47759. I am updating to 4.1.
If it helps you to find why this bug still exists, here is the how I did (it is pretty hard to remember accurately, but I think it is correct) :
1 - All my sub jobs included the 3 stats/logs/flow objets and a mysqlouput to DB.
2 - I removed in all my subjobs the 3 (objets -> mylsqoutput)
3 - I changed information in the referentiel (db host)
4 - I added uniques 3 (components -> mysqloutput) in my main scheduler
then the bug happens.
2 subjobs of the main scheduler are not impacted.
The third one (last one also) was bugging.

Regards

View solution in original post

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog