I have little more than 3 million records in my source db2 table. I m writing this to a csv file and it took 40 minutes for 2 million records and then failed with java heap space error. (around 600 records/s)
Note : I'm not creating the job in my local directory, in turn sending the data through output stream and creating the file on dropbox.
Can someone suggest me ways to increase performance in this case?
Thanks in advance for your help
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema
Pick up some tips and tricks with Context Variables