How to read large files in Talend Big Data Platform ?

Four Stars

How to read large files in Talend Big Data Platform ?

Hi All,
 
While reading .dat file of size around 500MB using tFileInputDelimited in Talend Big Data Platform (standard job) I am getting OutOfMemory error. Can anyone help me with this ?

Thanks in advance! 
 
Nine Stars

Re: How to read large files in Talend Big Data Platform ?

Hi,

 

what are you doing with your file? Did you try to increase Xms/Xmx ?

What is the exact error?

Regards

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now