I'm looking for the best way to log and report how a specific run of a job went.
For example :
- Schema check for input file xxxxx failed : did not produce output (14 lines could .
Job 2 :
- Produced output for 1925 lines out of 1940 lines in input.
- Error getting mapping for the field "AAA" in 6 lines - did not produce output. check specific errors log file.
- Error getting mapping for the field "BBB" in 9 lines - did not produce output. check specific errors log file.
I looked at various ways but I did not find any best-case solution :
Thank you for your advices.
The only "issue" I found using this method, is that catching the volumetrics and logs globally at the project level instead of doing it so at the job level (using a tFlowMeterCatcher), there is no header outputted to the resulting CSV file... Maybe it would be nice in a future version of Talend to let the user choose to add the header or not in the menu you showed me.
2016-04-21 09:18:03;xPvETY;xPvETY;xPvETY;3008;testProject;test;_qVyhMOa0EeWKMJszPPuHvA;0.1;testContext;tFlowMeter_7;Input lines;64;;
2016-04-21 09:18:15;xPvETY;xPvETY;xPvETY;3008;testProject;test;_qVyhMOa0EeWKMJszPPuHvA;0.1;testContext;tFlowMeter_7;Input lines;64;;
The first 100 community members completing the Open Studio survey win a $10 gift voucher.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend