[resolved] How can I know the number of records processed by a Talend Job?

Highlighted
Five Stars

[resolved] How can I know the number of records processed by a Talend Job?

Hi,
I have a job which loads data from file to a database and it is scheduled daily @10 PM.
I don't want to login into database and see how many records were processed.
How can I know the record count or the number of records processed by the job on that particular day?
If this information is logged somewhere, where can I see it in Talend?

Accepted Solutions
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

All Replies
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Five Stars

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi ,
In which component, I can use this below global variable. So, that the record count information will be available in my log.
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi 
In next subjob, you can generate this data on a tfixedFlowInput and write them to a log file, eg:
tFileInputDelimited--main--tMysqlOutput
   |
onsubjobok
  |
tFixedFlowInput--main--tFileOutputDelimited
----------------------------------------------------------
Talend | Data Agility for Modern Business

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads