Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap s

One Star

Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap s

Hi Folks , I'm new with Talend Data Integration  .. I'm doing a tMysqlIn-->tSortRow_1-->tUniqRow_1 -->tMysqlOut to remove the duplicated rows ..
The in Table have 8 million  rows  .. After 20 minutes I get the Error bellow .. Does anyone can help me to figure out ? Runing Localy in nice Server ..

Starting job duplicated at 16:07 31/03/2016.
connecting to socket on port 3527
connected
Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space
at java.util.LinkedList.listIterator(Unknown Source)
at java.util.AbstractList.listIterator(Unknown Source)
at java.util.AbstractSequentialList.iterator(Unknown Source)
at routines.system.RunStat.sendMessages(RunStat.java:261)
at routines.system.RunStat.run(RunStat.java:225)
at java.lang.Thread.run(Unknown Source)
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at com.mysql.jdbc.MysqlIO.nextRowFast(MysqlIO.java:2267)
at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:2044)
at com.mysql.jdbc.MysqlIO.readSingleRowSet(MysqlIO.java:3549)
at com.mysql.jdbc.MysqlIO.getResultSet(MysqlIO.java:489)
at com.mysql.jdbc.MysqlIO.readResultsForQueryOrUpdate(MysqlIO.java:3240)
at com.mysql.jdbc.MysqlIO.readAllResults(MysqlIO.java:2411)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2834)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2832)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2781)
at com.mysql.jdbc.StatementImpl.executeQuery(StatementImpl.java:1569)
at local_project.duplicated_0_1.duplicated.tMysqlInput_1Process(duplicated.java:2875)
at local_project.duplicated_0_1.duplicated.runJobInTOS(duplicated.java:4306)
at local_project.duplicated_0_1.duplicated.main(duplicated.java:4140)
disconnected
Job duplicated ended at 16:13 31/03/2016.
Moderator

Re: Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap s

Hi,


In your job, tUniqRow and tSortRow are cache components consuming two much memory. For a large set of data, try to store the data on disk instead of memory.


Here is a KB article about:TalendHelpCenter:Exception outOfMemory


Best regards


Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog