ETL Job performance

Highlighted
Five Stars

ETL Job performance

Hello,

 

I'm in the process of migrating out ETL jobs from ODI (Oracle Data Integrator) to Talend. We finally have Talend installed and a Jobserver set up and are doing some testing. Initial testing is showing performance in our current setup in ODI is twice as fast as Talend. The "jobserver" specifications are the same in Talend and ODI and they are accessing the same databases. We have 16gb memory on both Talend and ODI jobservers. Any performance tuning we can do to get Talend to match our ODI performance? Attached is one of the jobs that is slow.

Five Stars

Re: ETL Job performance

Any ideas here are much appreciated.

Moderator

Re: ETL Job performance

Hello,

What's your row rate per second?

In your work flow, tMap is a cache component consuming two much memory. Have you tried to try to store the data on disk instead of memory?

In the "advanced settings" tab of the tOracleInput component, did you check "Use cursor" option ? If not do it and try to play with the cursor size until you find which is best value for you.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Download