Improve performance of db2 to csv load

Eight Stars

Improve performance of db2 to csv load

Hi everyone,

 

I have little more than 3 million records in my source db2 table. I m writing this to a csv file and it took 40 minutes for 2 million records and then failed with java heap space error. (around 600 records/s)

Note : I'm not creating the job in my local directory, in turn sending the data through output stream and creating the file on dropbox.

 

Can someone suggest me ways to increase performance in this case?

 

Thanks in advance for your help

Eight Stars

Re: Improve performance of db2 to csv load

 

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog