I'm using enterprise version talend big data 6.4 version. I have a use case where i need run a job from TAC for multiple times simultaneously without creating the copies of the job in the job conductor.
Here is my exact problem statement,
I have a job that basically copies contents of a file in to a database, here the file path will be changing dynamically so i set it up as a context variable.
Now i have a airflow dag which calls my above talend job using a API call to trigger the job with the proper contexts. However, the problem is that if I trigger that job via API call to TAC, I have to wait for it to end before I call it with a different file path.
I want the job to trigger, then detach from the TAC immediately so I can call the same job with different contexts variables and have it run simultaneously with the first call, instead of having to wait for the first call to finish.
is there any way to solve this puzzle in TAC itself as we cannot alter the developed talend package?
Any help is appreciated.
P.S: I have come across a similar post in the community but it is unresolved.
Thanks in advance.
If you have runtime server then we can run Talend job through rest API. So in this case you have to create a REST API by using Talend ESB and deploy it in runtime server.
Watch the recorded webinar!
Introduction to Talend Open Studio for Data Integration.
Test drive Talend's enterprise products.
Practical steps to developing your data integration strategy.