tDBOutputBulkExec performance related

Highlighted
Seven Stars

tDBOutputBulkExec performance related

Hi All,

 

I am using tDBOutputBulkExec for faster execution, it takes around 30 mins to upload 5 Million records in Oracle DB.The bulk file parameters are as below

Buffer Size = 8192, StringBuilderSize = 1024

Is it possible to modify these parameters to gain performance or is there any other setting that can be updated to gain performance.

 

Thanks

 


Accepted Solutions
Seven Stars

Re: tDBOutputBulkExec performance related

Hi @vidya821 ,

 

For component parameter configuration, you can refer my comment in below link,

 

https://community.talend.com/t5/Design-and-Development/Oracle-data-export-and-import-by-talend-tool/...

 

Thanks,

Joe

Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.


All Replies
Employee

Re: tDBOutputBulkExec performance related

Hi Vidya,

 

    Before doing any further tweak, could you please run Oracle AWR or ADDM report with the help of DBA and see the overall performance of Database? Please check with DBA whether any DB level tuning can be done to pump more data. The advisor part of ADDM report usually recommends the changes.

 

    Coming to Talend side, you can increase the buffer size further provided you have suficient memory in both DB and Talend end. Please increment it in smaller values (say 1GB at a time) and see the deviation in performance.

 

    Again, the key mantra is that there is no magic number for performance tuning as lion's share of the tuning is determined by specific environment capabilities.

 

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved :-)

Seven Stars

Re: tDBOutputBulkExec performance related

Hi @vidya821 ,

 

For component parameter configuration, you can refer my comment in below link,

 

https://community.talend.com/t5/Design-and-Development/Oracle-data-export-and-import-by-talend-tool/...

 

Thanks,

Joe

Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog