We experienced slow transferring rate using JasperETL Pro for large datasets ie: >2 millions of records.
Does Talend having benchmark test result to share with us? I afraid there are 1 or more settings we could miss out that result poor performance?
Furthermore, would it be possible for us to get evaluation product for TIS & TDQ?
2)Regarding bulk load, is it "t000BulkExec" where 000=mysql, oracle...I understand that is loading data from a file but our design is loading data from 1 RDBMS to another RDBMS.
1) We are testing on 2 different server2 (Oracle -> Mysql) using 100mbps LAN. The new setting is commit every 1 row.
2) We are not using Load Data Infile. Therefore we did not test on t000OutputBulkExec. Most of situation we will transfer datasets involve 2 different RDBMS server (source, target)
2) Using tMySQLOutputBulkExec, it is only allow to output to csv file. We are unable to output to MySQL DB. Could you provide a sample for us to refer?
Starting job mysqlbulk at 15:44 23/11/2009.
connecting to socket on port 4115
Exception in thread "main" java.lang.Error: Unresolved compilation problems:
The constructor File() is undefined
Syntax error on token ";", delete this token
Job mysqlbulk ended at 15:44 23/11/2009.
<b> the field showing mandatory for FILE_NAME </b>
As I indicated earlier, we are not involving with file. It is extracting datasets from a Database and loading into another Database.