Performance Issue in tOracleOutput (because of Use an existing connection option)

Eight Stars

Performance Issue in tOracleOutput (because of Use an existing connection option)

Why tOracleOutput using existing connection (tOracleConnection) is getting poor performance in comparison to the tOracleOutput which is standalone(it contains the db details in it , hostname ,service name,username ,portnumber and password)?

 

What is the logic behind this slowness?

 

What is the correct situation to these differrent options.

 

 

Employee

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Hi Ashif,

 

      How did you measure the performance difference between two scenarios? We will have to make sure that the system resources are aligned same for both cases. If there are any underling queries running in Oracle database, that also can change the statistics.

 

      tOracleconnection just helps to use an existing open connection to do subsequent jobs. Could you check the details DB statistics with the help of an Oracle DBA and let us know whether issue persists?

 

Warm Regards,

 

Nikhil Thampi

 

Eight Stars

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Hi Nikhil,

 

Even in a simple scenario , I see the difference

 

I checked with simple one to one flow,

 

tOracleConnection

  |

  |

tFileInputDelimited--->tMap--->tOracleOuput(using Use an existing connection) its **bleep** slow.

 

When I update the job like below 

 

tOracleConnection

  |

  |

tFileInputDelimited--->tMap--->tOracleOuput(in-built connection details), the throughout is high .

 

Whats happening internally , I'm not sure ? 

 

 

 

Employee

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Hi,

 

     Please check the batch size of the tOracleOutput component whether it is too low. Could you please quantify the time difference between both ways of data loading?

 

     If you are absolutely sure that all the other parameters remain same (CPU utilization, number of connections, commit size memory usage in Talend and DB servers etc.) , culd you please log a JIRA ticket with details so that R&D team can have a look into it. The link for JIRA is as shown below.

 

      https://jira.talendforge.org

 

Warm Regards,

 

Nikhil Thampi

Five Stars

Re: Performance Issue in tOracleOutput (because of Use an existing connection option)

Hi,

Yes even I faced performance issues with use an existing conn enabled for tOracleOutput during the data loading.If it leads to performance issues then whats the use of tOracleConnection when I would like to connec to  same db multiple times and ending up with performance issues.

 

 

Thanks,

Kiran Kumar

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog