Extract a billion records using Talend Data Integration
Hi, May i know is this TOS for data integration might have a capability to extract a billions records? I need to extract out a billions of records from Oracle/db2 database. Anyone have any experience on this? Regards, Ommie
Re: Extract a billion records using Talend Data Integration
Talend does not have a limitation in processing number of row. You can process as many rows as you want/have. It is always a matter of efficiency and resources. Billions of row - why not. I would always try to separate a chunk of rows and avoid trying to process all rows at once. Processing billions of rows without separating it in chunks will lead into a nightmare on the productive system - regardless which tool do you use to do that.