I have a scenario where we have 10 jobs in the nightly execution plan. Each job has a tstat catcher component in it which writes the logs to a control table and there is a different job which sends out the results of this control table to all the users.
Recently we have faced a scenario where if a particular job is failing today, the target control table is not getting updated with the failure record.
Job ran Successfully on January 1st ---------> The final control table has the success record from January 1st
Job ran Successfully on January 2nd ---------> The final control table still has the success record from January 1st and not the failure record from January 2nd.
As a result the final email that is sent out to users is sending January 1st success info and not the January 2nd failure info.
Please help how to handle this scenario.
Would you mind posting your work flow screenshots on community which will be helpful for us to address your issue?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Accelerate your data lake projects with an agile approach