Any way to ignore Error in Talend and continue running the job?

One Star

Any way to ignore Error in Talend and continue running the job?

I am getting following root cause which is I believe due to bad data in txt file. Any way I can ignore such errors and continue with the next line in talend?
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Unknown Source)
at java.lang.String.<init>(Unknown Source)
at org.talend.fileprocess.TOSDelimitedReader.endColumn(TOSDelimitedReader.java:291)
at org.talend.fileprocess.TOSDelimitedReader.readRecord_SplitField(TOSDelimitedReader.java:152)
at org.talend.fileprocess.TOSDelimitedReader.readRecord(TOSDelimitedReader.java:125)
------------------------------------------------------------------------------------------------------------------------------------
Complete error
Exception in thread "main" java.lang.Error: java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_1Process(Copy_of_Location.java:3898)
at ruchi.copy_of_location_0_1.Copy_of_Location.runJobInTOS(Copy_of_Location.java:5749)
at ruchi.copy_of_location_0_1.Copy_of_Location.main(Copy_of_Location.java:5617)
Caused by: java.lang.Error: java.lang.OutOfMemoryError: Java heap space
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_2Process(Copy_of_Location.java:4718)
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_1Process(Copy_of_Location.java:2398)
... 2 more
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOfRange(Unknown Source)
at java.lang.String.<init>(Unknown Source)
at org.talend.fileprocess.TOSDelimitedReader.endColumn(TOSDelimitedReader.java:291)
at org.talend.fileprocess.TOSDelimitedReader.readRecord_SplitField(TOSDelimitedReader.java:152)
at org.talend.fileprocess.TOSDelimitedReader.readRecord(TOSDelimitedReader.java:125)
disconnected
disconnected
at org.talend.fileprocess.FileInputDelimited.nextRecord(FileInputDelimited.java:304)
at ruchi.copy_of_location_0_1.Copy_of_Location.tFileInputDelimited_2Process(Copy_of_Location.java:4566)
... 3 more
Job Copy_of_Location ended at 12:23 08/02/2013.
One Star

Re: Any way to ignore Error in Talend and continue running the job?

Hi,
Normally you can catch exeptions for example by using tRunjob (where you can use "independent process to run the job" ) to execute parts of the code or using the onComponentError trigger.
Java heap space indicates that there is enough memory available. Perhaps the txt file is very large? try changing the XMX / XMS settings in your job.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog