One Star

Getting the progress bar-during runtime-

hi all,
Is der any component is give us the progress of the load, (upart from the debug run).
i have a trigger job, consisting of 5 Trunjob components- which triggers 5 different jobs
and each job loads huge data around 3 4 million records into the database.
but, the problem is i m unable to see any progress in percentage at the runtime, when i run trigger job.!!
help needed,
thnkx in advance,
Roni
3 REPLIES

Re: Getting the progress bar-during runtime-

inside your flow, you can insert a tJavaRow to output progress information-- the code inside would look something like this:
if( (Integer)globalMap.get("tFileInputDelimited_1_NB_LINE") != null && (Integer)globalMap.get("tFileInputDelimited_1_NB_LINE") % 10000 == 0) {
System.out.println("Processed "+ globalMap.get("tFileInputDelimited_1_NB_LINE") + " rows...";
}
Seventeen Stars

Re: Getting the progress bar-during runtime-

Unfortunately this does not work, because the mentioned counter will only set after the flow is finished.
But the suggestion with tJavaRow is the correct start for solving this requirement. You should create your own counter but avoid writing every dataset as log to the console.
Talend mostly generates int variables like tos_count_<comp_name>. These variables will be incremented every dataset.
One Star

Re: Getting the progress bar-during runtime-

Hi All,
I would like to reopen this topic.
I am performing a migration in Talend Data Integration Studio. The migration process consists of several grand job, which hold subjobs. Unfortunately, when the migration is running, I cannot follow the actual progress because Talend show that only one row was migrated between subjobs. 
I need to have an ability to follow the actual progress in Talend by receiving information at runtime like: the number of rows, which have been already migrated, the number of errors, which subjob of the subjob is currently running etc.
Can anyone advise me, how this can be done?
Best regards,
Kapi