How to do Bulk Load for InfiniDB

One Star

How to do Bulk Load for InfiniDB

Hi guys,
I'm having a hard time using Talend when inserting 100millions up to 300millions of data because of the "Heap memory" exception. And as a quick workaround, I wanted to use the cpimport utility or the bulk load of InfiniDB in my talend jobs.
Can anyone show me an example of this scenario? Even a simple job below will do Smiley Happy
tBulkLoad--><cpimport>-->tMySQLOuput
Thanks so much!
Community Manager

Re: How to do Bulk Load for InfiniDB

Hi
Which component are you using for InfiniDB? tJDBCxxx component? As I seen, Talend does not provide proprietary components for InfiniDB.
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: How to do Bulk Load for InfiniDB

Hi shong,
Actually, I'm thinking of a shell script that will run the bulk loader,maybe two scripts it. Is it possible?
Community Manager

Re: How to do Bulk Load for InfiniDB

Hi shong,
Actually, I'm thinking of a shell script that will run the bulk loader,maybe two scripts it. Is it possible?

I know little about InfiniDB database, however, if the shell script can be called and executed from command prompt, you can use tSystem component to execute the script in Talend.
----------------------------------------------------------
Talend | Data Agility for Modern Business