Opening/Closing of multiple MySQL connections in parallel

Five Stars

Opening/Closing of multiple MySQL connections in parallel

Hi,

 

I have a job that takes in data from sql server and puts them in mysql. I have used tmysqlconnection, tmysqlcommit and tmysqlrollback.

 

Similar to the above I have 15+ jobs. All these jobs must run in parallel

 

What problems might I face if the opening/closing of mysql connection happens 15+ times simultaneously?

 

Thanks in advance

Rathi


Accepted Solutions
Seven Stars

Re: Opening/Closing of multiple MySQL connections in parallel

It depends on your mysql configuration. You can check with your dba. how many parallel connection allowed. Also at the same time you have to consider connections opened by other jobs/process.
you can use connection name as your jobName, so it is common per your job and at last you can close the connection.

All Replies
Employee

Re: Opening/Closing of multiple MySQL connections in parallel

No problems at all, unless you are restricted by the number of connections that your MySQL database allow.  You must tweak your mysql database to allow the number of connections you have per job X the number of jobs you are running.

Look also at the performance of your DB when you have 15+ jobs trying to insert/update/delete data to your DB.  Your DB can become the bottleneck if it cannot cope with the throughput thrown at it.

Seven Stars

Re: Opening/Closing of multiple MySQL connections in parallel

It depends on your mysql configuration. You can check with your dba. how many parallel connection allowed. Also at the same time you have to consider connections opened by other jobs/process.
you can use connection name as your jobName, so it is common per your job and at last you can close the connection.
Five Stars

Re: Opening/Closing of multiple MySQL connections in parallel

Thank you !! That answers my question !

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Why Companies Move to the Cloud: 7 Success Stories

Learn how and why companies are moving to the Cloud

Read Now