java.lang.OutOfMemoryError: Java heap space with Microsoft Access database

Three Stars

java.lang.OutOfMemoryError: Java heap space with Microsoft Access database

Hi,

 

I'm trying to load data from MS Access 2000 databases with Tand Open Studio (6.3.1)

I have about 100 Access database to load each night

(fortunatly each database has the same exact structure)

 

So, i have build an unique job and use a context to modifiy the file name and the path of the .MDB file

It works perfect ; but time to time I have this error on the console :

 

Exception in thread "Thread-610" java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space

 

I have read many hints on internet about this problem

What I have tried so far :

 

- I check that "memory=false" is specified in the additionnals parameters of Access connection

- I have improve memory with "-Xms1024M" and "-Xmx4096M" in the "TOS_DI-win-x86_64.ini" file and in the Preferences > Talend > Run/Debug

 

What can I do more ?

 

In the view "Module" i can see the module "ucanaccess-2.0.9.5.jar" but on the ucanaccess website (http://ucanaccess.sourceforge.net/site.html) I can see that the last version is 4.0.3. ? Anyway to upgrade the Talend module ?

 

Any help will be welcome

Thanks

Tags (1)
Sixteen Stars

Re: java.lang.OutOfMemoryError: Java heap space with Microsoft Access database

Can you show us your job layout? You might be able to make it more memory efficient.

Three Stars

Re: java.lang.OutOfMemoryError: Java heap space with Microsoft Access database

OK, it look like this

For each table tAccessInput -> tMap -> tPostgresqlOutput

in the tAccessInput, Property Type is in "Built-In" with Database specified by context. In advanced settings, additional JDBC Parameters "memory=false"

 

job_Access.png

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.