Is there any component to capture all the log details.

Highlighted
Six Stars

Is there any component to capture all the log details.

Hi All,

 

I want to create a reuseable component or use any existing component and capture details required to populate logs table. Details include source name, target name, count of the records, job status, no of columns, date and time of the load etc etc.

 

Can i use this components at project level, so all the job runs are captured?

 

Can anyone help me with this.

 

Cheers!

 

 

 

I wa

Moderator

Re: Is there any component to capture all the log details.

Hello,
Talend provides user with Stat&log in project setting and Stat&log in job view.
Stat&log in project setting is working on the whole project (Parent job and child jobs, and output them on file/DB but no context setting).
Stat&log in job view is working on the current job (you should set Stat&log of job view in both parent job and child jobs and output them on file/DB with context setting.
If you want to modify schema of log/stat file, you have to use a single component.
For example: tlogcather-->tMap(modify schema)-->t<xx>output..

For more information, please have a look at this online documentation:

https://help.talend.com/reader/SY4K8FlNZd1_LG0DB1gAcw/JQORw7ZKZORRJEX0DjEXwg

Let us know if it helps.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: Is there any component to capture all the log details.

Thanks for the reply @xdshi But i don't think log or stats catcher will get the source name, target name or count.. correct me if i'm wrong.

Moderator

Re: Is there any component to capture all the log details.

Hello,

The feature of Stat&log in talend have tFlowMeterCatcher and tFlowMeter, which operates as a log function triggered by the use of a tFlowMeter component in the Job.

You will be able to get the actual number of rows being processed(count) from it.

Feel free to let us know if this scenario helps.

https://help.talend.com/reader/zEy_94YeKg9FVbqEiggFag/jiX4cf_gtaFoe5KCDAYv9w

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog