Sightly different scenario!Can we get the count of jobs created,status of the jobs(executed/failed/successful)
from those log file on a daily basis.If an user tries to find with date can he have those info from those file.Is it a single file for each day for all the tasks have been performed by TAC on that day?Cculd you please help on that?
The best way to extract the historical processing information in Talend will be through AMC.
In that case, you will have to parse the log files based on your needs and based on the input data available in log files, you can achieve the job tracking. But you will have to build those custom codes to read the log files and parse according to your need.
Job failure can happen due to multiple reasons. For example, the jobs may not read into the log folder due to multiple reasons (a very common example is 100% space utilization). In that case, the log file will not have complete data. So reading the log files alone will not help you to achieve this task.
Also it depends on the amount of logging you are forcing the Talend to do based on your custom coding. It will be a good idea to measure the time and effort required to do this verification and compare the time and cost part with subscription amount of Talend with AMC feature.
I would say it is quite possible to do it by custom coding but error probability will be higher and you will have to ensure that you have mechanisms to catch all different scenarios.
Introduction to Talend Open Studio for Data Integration.
Practical steps to developing your data integration strategy.
Create systems and workflow to manage clean data ingestion and data transformation.