Four Stars

Taking much time to load data to a flat file from Oracle

Hi All,

I just installed Talend Open Studio 6.4.1 version in my local PC.
I want to transfer the data (around  6.8 Millions) from Oracle DB and writes to a flat file (around 2GB in size) without any transformations in between. I designed a job and running, it is taking much time to load. In Talend it is taking 30 mins to load 1 lakh records.
I need your expert advise how to improve performance and also please let me know if I am doing anything wrong.

Design:

toracleInput --> tFileOutputDelimeter


Thanks,
Basha

1 ACCEPTED SOLUTION

Accepted Solutions
Six Stars

Re: Taking much time to load data to a flat file from Oracle

You can select 'Use cursor' check box and in the Cursor size field displayed, specify the number of rows to fetch in one go from the database.
3 REPLIES
Six Stars

Re: Taking much time to load data to a flat file from Oracle

You can select 'Use cursor' check box and in the Cursor size field displayed, specify the number of rows to fetch in one go from the database.
Four Stars

Re: Taking much time to load data to a flat file from Oracle

Thanks for your answer. It helps me lot.

I have use Cusrsor set 50000 record , Now it finish 90 sec to complete 5  lakh records.

Can able to increase more data transfer?

Six Stars

Re: Taking much time to load data to a flat file from Oracle

Sure! You can increase it , until unless you are having me memory issues.