tStatCatcher - Get only end logs

Highlighted
Four Stars

tStatCatcher - Get only end logs

Hi everyone,

 

I want to retrieve some of the logs from my job but I don't know.

 

Today I set: tStatCatcher -> tMap -> tLogRow

 

When I run my job, here are the logs:

 

Starting the TEST job at 17:09 19/07/2017.
[Statistics] connecting to socket on port 3487
[Statistics] connected
2017-07-19 17: 09: 23 | 2017-07-19 17: 09: 23 | TEST | FLUX | 0 | KO |
2017-07-19 17: 09: 25 | 2017-07-19 17: 09: 27 | TEST | FLUX | 2 | OK |
[Statistics] disconnected
Job TEST finished at 17:09 19/07/2017. [Output code = 0]

 

I only want the statistics before the end of the job (in bold) and not the start.

Do you have an idea to do this simply?

 

Thank's !


Accepted Solutions
Highlighted
Employee

Re: tStatCatcher - Get only end logs

Hi,

 

In your log, I do not see the message_type.  In  mine, I can see message_type:

StatCatcher.jpg

 

Normally, in your tMap, you will just filter on message_type.equals("end")

View solution in original post


All Replies
Highlighted
Employee

Re: tStatCatcher - Get only end logs

Hi,

 

In your log, I do not see the message_type.  In  mine, I can see message_type:

StatCatcher.jpg

 

Normally, in your tMap, you will just filter on message_type.equals("end")

View solution in original post

Highlighted
Community Manager

Re: tStatCatcher - Get only end logs

As @iburtally said, you need to look for the message_type. You will also have to keep in mind that you do not get the start and end on the same record. You will see two records. These can be joined using the PID record. I have put together a brief piece on the AMC here: https://www.rilhia.com/tutorials/talend-activity-monitoring-console-amc

Highlighted
Four Stars

Re: tStatCatcher - Get only end logs

Perfect !

Thank you for your help !

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog