ETL Job performance

Five Stars

ETL Job performance

Hello,

 

I'm in the process of migrating out ETL jobs from ODI (Oracle Data Integrator) to Talend. We finally have Talend installed and a Jobserver set up and are doing some testing. Initial testing is showing performance in our current setup in ODI is twice as fast as Talend. The "jobserver" specifications are the same in Talend and ODI and they are accessing the same databases. We have 16gb memory on both Talend and ODI jobservers. Any performance tuning we can do to get Talend to match our ODI performance? Attached is one of the jobs that is slow.

Highlighted
Five Stars

Re: ETL Job performance

Any ideas here are much appreciated.

Moderator

Re: ETL Job performance

Hello,

What's your row rate per second?

In your work flow, tMap is a cache component consuming two much memory. Have you tried to try to store the data on disk instead of memory?

In the "advanced settings" tab of the tOracleInput component, did you check "Use cursor" option ? If not do it and try to play with the cursor size until you find which is best value for you.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.