I have a series of jobs which I call via a .bat file for scheduling. The bat file includes includes the jar files which i use to call the talend jobs, however the job is taking a lot of time to process the data (approx 3 hrs) to complete jobs. Any suggestions to make the jobs fast?
You might be having lot of data volume but the memory parameters given in the job might be minimal. Also you need to check whether you have optimized your lookups. It will be always better if you can reduce the result set at the beginning of the job itself.
Sharing the job design will help us to understand your job better and can give more precise thoughts.
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Read about some useful Context Variable ideas