I hope you can help me further...
I have created a simple job (see attached screen shot below) using tFlowToIterate for looping (one sequence number after the other is loaded and compared to the last valid row of data).
As higher the sequence number gets, as lower the number of rows handled in one loop (first ~ 200.000 rows, last ony one row).
While number of rows were high, the runtime of the job seemed to be good, but with low number of rows in the loop the processing itself takes milliseconds but the starting part takes several seconds.
Since I have to process arount 21.000 loops this time when the sub job is "Starting" is really causing major runtime issues.
Do you have any idea wht I can do to reduce the "Starting" time?
Thank you and best regards
Solved! Go to Solution.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema