Error: java.lang.OutOfMemoryError: Java heap space

Six Stars

Error: java.lang.OutOfMemoryError: Java heap space

Hi everybody.

 

Again, I REALLY need your help Woman Sad

 

I'm having the error "Exception in thread "main" java.lang.OutOfMemoryError: Java heap space".

ErrorTalend.JPG

My OS is Windows 7 Professional Service Pack 1, 64 bits and my RAM 8GB. I'm using Talend Open Studio for Data Integration, Version: 7.0.1

 Windows.JPGTalend2.JPGTalend1.JPGJava.JPG

Right now, I'm trying to read an Excel file with 1 million rows and 34 columns aprox. full of data, using tFileInputExcel and a tLogRow, but my job only reads the first row (header) and then I get the error.

 Test.JPG

If I can read all the data (I hope you can help me with this), I'll process the information with components such as tMap, tAggregateRow, tPivotToColumnsDelimited, tFilterRow, tHashInput and tHashOutput, sending the entire results to a tFileOutputExcel & tFileOutputDelimited.

FullJob.JPG  My advanced settings are:

 -Xsm256M

 -Xmx2048m

 -XX:-UseGCOverheadLimit

 

Any suggestion? If somebody thinks that I could send you the file I'm trying to read (to ckeck if the problem is my computer), just tell me (it's an excel file .xlsx, 153MB)

 

Thanks!

Forteen Stars TRF
Forteen Stars

Re: Error: java.lang.OutOfMemoryError: Java heap space

What if you try with -Xmx4096m?

TRF
Six Stars

Re: Error: java.lang.OutOfMemoryError: Java heap space

Hi!

I get the same error (after 24 minutes) Smiley Sad Another suggestion? Thanks!

ErrorTalend2.JPG

Highlighted
Forteen Stars TRF
Forteen Stars

Re: Error: java.lang.OutOfMemoryError: Java heap space

You can reduce the required memory space by replacing tHash components by files.

You can also store temporary data required by tMap components on disk.

For this,  click on the 3rd icone on the upper left corner of the tMap then indicate the "Temp data directory path" and the buffer size.

 


TRF
Thirteen Stars

Re: Error: java.lang.OutOfMemoryError: Java heap space

and never use tLogRow connected to 1M rows source - it kills your studio!

-----------

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.