One Star

TDI 5.6.0 : No jobserver logs in the TAC logging page

Hello world,
I have some problem  to get jobsServer logs to be displayed on TAC Logging page.
I installed all modules with the default settings. The log4j port for jobserver in logstash configuration file is 5055.
I don't change anything in the jobserver config file.
On the first screen shot, i have a job that failed on my job server.
On the Kibana dashboard I have 9 errors that have been detected. but Only the TAC type messages are available int the charts below and in the detailed message list.
Do i Miss something in the jobserver configuration process ?
Best regards
JL Lecardinal


5 REPLIES
Moderator

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Have you already checked documents about:TalendHelpCenter: Setting up the Logging parameters and 
TalendHelpCenter: Displaying log events?
Best regards
Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Yes, I already checked these documentations and verified the configuration page.
I modified the org.talend.remote.jobserver.commons.config.JobServerConfiguration.ROOT_PATH parameter int TalendJobServer.properties file to set the correct jobserver filepath (C:\\Talend\\WorkingDirs\\JobServersFiles).
Should i modify something to activate the jobserver execution logs that are located now in C:\Talend\WorkingDirs\JobServersFiles\jobexecutions\logs ?
Best regards
Jean-Luc
One Star

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hi,
Jobserver and components are now available on the TAC logging page.
I modified the log4j.xml file in the jobserver installation directory by addind the following lines:
<appender name="logstash" class="org.apache.log4j.net.SocketAppender">
       <param name="RemoteHost" value="seraimtal01"/>
       <param name="Port" value="8055"/>
</appender>
<root>
......
       <appender-ref ref="logstash"/>
</root>

and activated Log4J logging in the studio.
Best regards
Jean-Luc Lecardinal
One Star

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Hello,
Jean Luc you find the solution ?, i have the same problem, i install standalone jobserver in a server, and (tac, logserver...) in another server, and i want to log the jobserver in TAC logstatsh, your solution is it work ?
Thanks
Employee

Re: TDI 5.6.0 : No jobserver logs in the TAC logging page

Those changes did not make Talend 6.0+ capture the logging details for the jobserver in Elasticsearch. I used the below log4j.xml file which then worked for me:

 

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE log4j:configuration SYSTEM "log4j.dtd">

<log4j:configuration xmlns:log4j="http://jakarta.apache.org/log4j/">

<!-- For layout pattern, see doc at https://urldefense.proofpoint.com/v2/url?u=http-3A__jakarta.apache.org_log4j_docs_api_org_apache_log... -->

<appender name="A1" class="org.apache.log4j.RollingFileAppender">
<param name="File" value="jobserver.log" />
<param name="Append" value="true" />
<param name="Threshold" value="info" />
<param name="MaxFileSize" value="1000KB" />
<param name="MaxBackupIndex" value="100" />
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern" value="%d %-5p %c{1} - %m%n"/>
</layout>
</appender>

<appender name="STDOUT" class="org.apache.log4j.ConsoleAppender">
<param name="Threshold" value="info" />
<layout class="org.apache.log4j.PatternLayout">
<param name="ConversionPattern"
value="%-5p %c{1} - %m%n"/>
</layout>
</appender>

<appender name="LOGSTASH" class="org.apache.log4j.net.SocketAppender">
<param name="RemoteHost" value="localhost"/>
<param name="Port" value="8055"/>
</appender>

<!-- Set here specific level for classes -->
<!-- logger name="org.eclipse.emf.teneo.hibernate.mapping.property.EAttributePropertyHandler"> <level value="warn" /> </logger-->

<logger name="org.talend" additivity="true"> <level value="info" /> </logger>
<logger name="org.talend.monitoring.jmx.api.OsInfoRetriever"> <level value="warn" /> </logger>
<logger name="sigar.CPUMonitoringData"> <level value="info" /> </logger>

<root>
<priority value ="info" />
<!-- scorreia: put here your appenders -->
<appender-ref ref="STDOUT" />
<appender-ref ref="A1" />
<appender-ref ref="LOGSTASH" />
</root>
</log4j:configuration>