Seven Stars

Run a task for multiple times simultaneously through job conductor by using a rest API call

Hi team,

I'm using enterprise version talend big data 6.4 version. I have a use case where i need run a job from TAC for multiple times simultaneously without creating the copies of the job in the job conductor.

Here is my exact problem statement,

I have a job that basically copies contents of a file in to a database, here the file path will be changing dynamically so i set it up as a context variable. 
Now i have a airflow dag which calls my above talend job using a  API call to trigger the job with the proper contexts. However, the problem is that if I trigger that job via API call to TAC, I have to wait for it to end before I call it with a different file path.
 I want the job to trigger, then detach from the TAC immediately so I can call the same job with different contexts variables and have it run simultaneously with the first call, instead of having to wait for the first call to finish.
is there any way to solve this puzzle in TAC itself as we cannot alter the developed talend package?

Any help is appreciated.

P.S: I have come across a similar post in the community but it is unresolved.

https://community.talend.com/t5/Design-and-Development/Running-same-job-multiple-times-for-reading-f...

Thanks in advance.

Tags (2)
3 REPLIES
Seven Stars

Re: Run a task for multiple times simultaneously through job conductor by using a rest API call

Hi Karthik,

 

If you have runtime server then we can run Talend job through rest API. So in this case you have to create a REST API by using Talend ESB and deploy it in runtime server.

Thanks & Regards
A Ravi Kumar
Mobile Number : +91 852-762-1083
Email-id : a.ravikumar104@gmail.com
Skype Id : ammanannaravikumar
Seven Stars

Re: Run a task for multiple times simultaneously through job conductor by using a rest API call

hi @RaviKumar we dont have talend ESB in our stack.
Seven Stars

Re: Run a task for multiple times simultaneously through job conductor by using a rest API call

hi ravi, can you elaborate your solution. or else you can guide me to any valid link with the solution for the proposed problem statement