tLogCatcher - for each job

Highlighted
Seven Stars

tLogCatcher - for each job

Hi,

 

Since it is required to have the logs and stat at job level, I have created tLogCatcher and tStatCatcher as suggested in Talend.

 tLogCatcher -----> tFileOutputDelimited (File Name : "C:/Talend/logs/" +jobName  + "_logs_" + globalMap.get("foo") + ".csv")

tStatCatcher ------>tFileOutputDelimited (File Name : "C:/Talend/logs/" +jobName  + "_logs_" + globalMap.get("foo") + ".csv")

 

where foo is:

tPrejob_1 --------> tJava_1

globalMap.put("foo",TalendDate.getDate("yyyy_MM_dd_hhmmss"));

 

tLogCatcher is chosen for all Catches(Java Exception, tDie, tWarn and tJobFailure).

 

When I run the job tStatCatcher gets executed(with 1 rows) but tLogCatcher is not logging.

tLogCatcher is not catching any data with NO log file created.

The logs are being displayed in the console. I get the below error displaying in console but not in log file:

C:\Talend\LastID_T7.csv (The system cannot find the file specified)
[ERROR]: local_project.xxxx_0_1.xxxx - tFileInputDelimited_1 - xxxx

 

Any idea as why this error is not getting captured in log but displaying in console.

 

Thanks.

 

 

Employee

Re: tLogCatcher - for each job

Hi,

 

    You do not have to capture all the errors and warnings manually. You can use either AMC or Talend logserver to do this activity.

 

     I have added some links for your reference. Could you please go through them and use either one of them?

 

https://www.talend.com/resources/data-integration-amc-studio-features/

https://help.talend.com/reader/4EbX3_8Mtb7L8ebe3PmVKQ/X6cvCSEK1ndGFwPRCF_DwQ

https://help.talend.com/reader/P_WfH1B7zRdEI74m2jpD7g/ATsNPKoGjJcDIaLrfv6bFw

 

If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi

Highlighted
Seven Stars

Re: tLogCatcher - for each job

Thanks Nikil,

 

But the jobs would be running as batch jar rather than TAC.

That's why there is a need to capture all logs and activity.

Could you kindly provide references to manually capture all logs.

 

Thanks.

Highlighted
Seven Stars

Re: tLogCatcher - for each job

Expectations: Error messages and System.out.println statement - to be captured.

Highlighted
Two Stars

Re: tLogCatcher - for each job


@nikhilthampi wrote:

Hi,

 

    You do not have to capture all the errors and warnings manually. You can use either AMC or Talend logserver to do this activity.

 

     I have added some links for your reference. Could you please go through them and use either one of them?

 

https://www.talend.com/resources/data-integration-amc-studio-features/

https://help.talend.com/reader/4EbX3_8Mtb7L8ebe3PmVKQ/X6cvCSEK1ndGFwPRCF_DwQ

https://help.talend.com/reader/P_WfH1B7zRdEI74m2jpD7g/ATsNPKoGjJcDIaLrfv6bFw/buyessays

 

If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi


What a luck there is a solid solution to avoid capturing errors manually. 

 

 

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog