Any way to ignore Error in Talend and continue running the job?

One Star

Any way to ignore Error in Talend and continue running the job?

I am getting following root cause which is I believe due to bad data in txt file. Any way I can ignore such errors and continue with the next line in talend?
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Unknown Source)
at java.lang.String.<init>(Unknown Source)
at org.talend.fileprocess.TOSDelimitedReader.endColumn(TOSDelimitedReader.java:291)
at org.talend.fileprocess.TOSDelimitedReader.readRecord_SplitField(TOSDelimitedReader.java:152)
at org.talend.fileprocess.TOSDelimitedReader.readRecord(TOSDelimitedReader.java:125)
------------------------------------------------------------------------------------------------------------------------------------
Complete error
Exception in thread "main" java.lang.Error: java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_1Process(Copy_of_Location.java:3898)
at ruchi.copy_of_location_0_1.Copy_of_Location.runJobInTOS(Copy_of_Location.java:5749)
at ruchi.copy_of_location_0_1.Copy_of_Location.main(Copy_of_Location.java:5617)
Caused by: java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_2Process(Copy_of_Location.java:4718)
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_1Process(Copy_of_Location.java:2398)
... 2 more
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Unknown Source)
at java.lang.String.<init>(Unknown Source)
at org.talend.fileprocess.TOSDelimitedReader.endColumn(TOSDelimitedReader.java:291)
at org.talend.fileprocess.TOSDelimitedReader.readRecord_SplitField(TOSDelimitedReader.java:152)
at org.talend.fileprocess.TOSDelimitedReader.readRecord(TOSDelimitedReader.java:125)
disconnected
disconnected
at org.talend.fileprocess.FileInputDelimited.nextRecord(FileInputDelimited.java:304)
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_2Process(Copy_of_Location.java:4566)
... 3 more
Job Copy_of_Location ended at 12:23 08/02/2013.
One Star

Re: Any way to ignore Error in Talend and continue running the job?

Hi,
Normally you can catch exeptions for example by using tRunjob (where you can use "independent process to run the job" ) to execute parts of the code or using the onComponentError trigger.
Java heap space indicates that there is enough memory available. Perhaps the txt file is very large? try changing the XMX / XMS settings in your job.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Why Companies Move to the Cloud: 7 Success Stories

Learn how and why companies are moving to the Cloud

Read Now