tOraleInput significantly slower than SQL client

Highlighted
Five Stars

tOraleInput significantly slower than SQL client

Dear all

I have a simple tOracleInput component that (should) writes to a CSV file. 

The query ran by the component takes so long that I could not even start seeing the first result row returned when outputting to a tLogRow.

When I run the same SQL from SQLDeveloper it takes 28 seconds to return the first row set and a total of 60 seconds for the full dataset (6.800 rows). 

 

The tOracleInput has connection settings in the component itself and the "Use cursor" option is disabled. 

I'm on Talend for Data Integration 6.1.1. 

 

What can I try doing to have the same runtime I experience in SQL Developer?

 

Thank you 

 

Tags (1)
Highlighted
Eight Stars

Re: tOraleInput significantly slower than SQL client

Try enabling/increasing 'Use cursor'.
Its default size is 10
Highlighted
Moderator

Re: tOraleInput significantly slower than SQL client

Hi,

What does your query in tOracleInput component look like?

You can select 'Use cursor' check box and in the Cursor size field displayed, specify the number of rows to fetch in one go from the database. The performance can be improved by tuning this fetch size to an appropriate value.

More information will be preferred.

Best regards

Sabrina

 
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog