[resolved] How can I know the number of records processed by a Talend Job?

Five Stars

[resolved] How can I know the number of records processed by a Talend Job?

Hi,
I have a job which loads data from file to a database and it is scheduled daily @10 PM.
I don't want to login into database and see how many records were processed.
How can I know the record count or the number of records processed by the job on that particular day?
If this information is logged somewhere, where can I see it in Talend?

Accepted Solutions
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

All Replies
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi
There are some global variables pre-defined on the component, these variable counts the total number of processed records, such as 
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
This variable counts the total number of inserted records. 
You can use these variables directly and log them in log file or database. 
Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Five Stars

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi ,
In which component, I can use this below global variable. So, that the record count information will be available in my log.
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))
Community Manager

Re: [resolved] How can I know the number of records processed by a Talend Job?

Hi 
In next subjob, you can generate this data on a tfixedFlowInput and write them to a log file, eg:
tFileInputDelimited--main--tMysqlOutput
   |
onsubjobok
  |
tFixedFlowInput--main--tFileOutputDelimited
----------------------------------------------------------
Talend | Data Agility for Modern Business

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download