TDI 5.6.0 : No jobserver logs in the TAC logging page

Four Stars

TDI 5.6.0 : No jobserver logs in the TAC logging page

Hello world,
I have some problem  to get jobsServer logs to be displayed on TAC Logging page.
I installed all modules with the default settings. The log4j port for jobserver in logstash configuration file is 5055.
I don't change anything in the jobserver config file.
On the first screen shot, i have a job that failed on my job server.
On the Kibana dashboard I have 9 errors that have been detected. but Only the TAC type messages are available int the charts below and in the detailed message list.
Do i Miss something in the jobserver configuration process ?
Best regards
JL Lecardinal


Moderator

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Have you already checked documents about:TalendHelpCenter: Setting up the Logging parameters and 
TalendHelpCenter: Displaying log events?
Best regards
Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Yes, I already checked these documentations and verified the configuration page.
I modified the org.talend.remote.jobserver.commons.config.JobServerConfiguration.ROOT_PATH parameter int TalendJobServer.properties file to set the correct jobserver filepath (C:\\Talend\\WorkingDirs\\JobServersFiles).
Should i modify something to activate the jobserver execution logs that are located now in C:\Talend\WorkingDirs\JobServersFiles\jobexecutions\logs ?
Best regards
Jean-Luc
Four Stars

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Jobserver and components are now available on the TAC logging page.
I modified the log4j.xml file in the jobserver installation directory by addind the following lines:
<appender name="logstash" class="org.apache.log4j.net.SocketAppender">
       <param name="RemoteHost" value="seraimtal01"/>
       <param name="Port" value="8055"/>
</appender>
<root>
......
       <appender-ref ref="logstash"/>
</root>

and activated Log4J logging in the studio.
Best regards
Jean-Luc Lecardinal
One Star

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hello,
Jean Luc you find the solution ?, i have the same problem, i install standalone jobserver in a server, and (tac, logserver...) in another server, and i want to log the jobserver in TAC logstatsh, your solution is it work ?
Thanks
Employee

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Those changes did not make Talend 6.0+ capture the logging details for the jobserver in Elasticsearch. I used the below log4j.xml file which then worked for me:

 

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE log4j:configuration SYSTEM "log4j.dtd">

<log4j:configuration xmlns:log4j="http://jakarta.apache.org/log4j/">

<!-- For layout pattern, see doc at https://urldefense.proofpoint.com/v2/url?u=http-3A__jakarta.apache.org_log4j_docs_api_org_apache_log... -->

<appender name="A1" class="org.apache.log4j.RollingFileAppender">
<param name="File" value="jobserver.log" />
<param name="Append" value="true" />
<param name="Threshold" value="info" />
<param name="MaxFileSize" value="1000KB" />
<param name="MaxBackupIndex" value="100" />
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern" value="%d %-5p %c{1} - %m%n"/>
</layout>
</appender>

<appender name="STDOUT" class="org.apache.log4j.ConsoleAppender">
<param name="Threshold" value="info" />
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern"
value="%-5p %c{1} - %m%n"/>
</layout>
</appender>

<appender name="LOGSTASH" class="org.apache.log4j.net.SocketAppender">
<param name="RemoteHost" value="localhost"/>
<param name="Port" value="8055"/>
</appender>

<!-- Set here specific level for classes -->
<!-- logger name="org.eclipse.emf.teneo.hibernate.mapping.property.EAttributePropertyHandler"> <level value="warn" /> </logger-->

<logger name="org.talend" additivity="true"> <level value="info" /> </logger>
<logger name="org.talend.monitoring.jmx.api.OsInfoRetriever"> <level value="warn" /> </logger>
<logger name="sigar.CPUMonitoringData"> <level value="info" /> </logger>

<root>
<priority value ="info" />
<!-- scorreia: put here your appenders -->
<appender-ref ref="STDOUT" />
<appender-ref ref="A1" />
<appender-ref ref="LOGSTASH" />
</root>
</log4j:configuration>

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

APIs for Dummies

View this on-demand webinar about APIs....

Watch Now