Getting java.lang.OutOfMemoryError: Java heap space error

Four Stars

Getting java.lang.OutOfMemoryError: Java heap space error

Hi All,
I am getting java.lang.OutOfMemoryError: Java heap space error when i run below job.

My job is only reading data from Oracle database and loading data to Redshift without any transformations but it is moving 26 million records from Oracle to Redshift, job is aborting after moving 5 million with heap space error.
I have used JVM arguments -Xmx1024M & -Xms256M as shown in the above screenshot but still getting same error.
Our Runtime and TAC servers are 64 bit Ubuntu OS with 8 GB memory.
Can someone explain me reason for heap space error as i am not using any transformation or other components that buffers data in to the memory and solutions to fix this issue.
Here is some more info on redshift configuration

Thanks & Regards,
SaiSridhar N
Moderator

Re: Getting java.lang.OutOfMemoryError: Java heap space error

Hi,
Thank you for your post! We can't see the screenshot on our side. Could you attach it on the forum, please? That would be great.
Would you mind posting your current job design screenshots into forum?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Getting java.lang.OutOfMemoryError: Java heap space error

Hi Sabrina,
Attached are the screenshots of Job design and configurations.
After increasing the JVM size and using cursor option on source database, job loaded around 11 million and failed again.
Moderator

Re: Getting java.lang.OutOfMemoryError: Java heap space error

Hi,
Sorry for delay!
Could you please indicate the build version you are using?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Downloads and Trials

Test drive Talend's enterprise products.

Downloads