Log file levels and SQL Query logging

Highlighted
Seven Stars

Log file levels and SQL Query logging

Hi,

 

I have some complex jobs deployed and they usually runs with "Info" or "Warn" log level set.

Sometimes I would have SQL Query logged but when I set Log4J level to Debug I get hundreds of thousands log rows like:

[DEBUG]: part_kpi.part_technical_kpi_calculation_2_9.PART_Technical_KPI_Calculation - tPostgresqlInput_1 - Retrieving the record 2.

that makes huge logfiles.

 

Any chance to have those kind of rows switched-off?

 

Thank you in advance,

Lorenzo

 

 

Highlighted
Employee

Re: Log file levels and SQL Query logging

You can if you can change the log4j.xml file that is provided with the job.  I haven't tried thiough.  You can be very selective if you understand log4j configuration well.

Highlighted
Seven Stars

Re: Log file levels and SQL Query logging

You can try using twarn component if you place b/w 2 components you can get the row value into the logger message like row1.columnname , 

i think you can write a logger message using itinerary operator like   row1.columnname == conditionvalue ? row1.columnname : ""

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

The Forrester Wave: Strategic iPaaS and Hybrid Integration Platforms, Q1 2019

Find out how Forrester rate different iPaaS and Hybrid Integration Platforms

Read

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog