Log file levels and SQL Query logging

Seven Stars

Log file levels and SQL Query logging

Hi,

 

I have some complex jobs deployed and they usually runs with "Info" or "Warn" log level set.

Sometimes I would have SQL Query logged but when I set Log4J level to Debug I get hundreds of thousands log rows like:

[DEBUG]: part_kpi.part_technical_kpi_calculation_2_9.PART_Technical_KPI_Calculation - tPostgresqlInput_1 - Retrieving the record 2.

that makes huge logfiles.

 

Any chance to have those kind of rows switched-off?

 

Thank you in advance,

Lorenzo

 

 

Employee

Re: Log file levels and SQL Query logging

You can if you can change the log4j.xml file that is provided with the job.  I haven't tried thiough.  You can be very selective if you understand log4j configuration well.

Seven Stars

Re: Log file levels and SQL Query logging

You can try using twarn component if you place b/w 2 components you can get the row value into the logger message like row1.columnname , 

i think you can write a logger message using itinerary operator like   row1.columnname == conditionvalue ? row1.columnname : ""

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

The Forrester Wave: Strategic iPaaS and Hybrid Integration Platforms, Q1 2019

Find out how Forrester rate different iPaaS and Hybrid Integration Platforms

Read

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog