One Star

[resolved] DI job with "file exists" trigger?

Hi everyone,
is it possible for a DI job to continuously watch a directory and start its job once a file with the right pattern has been delivered?
After all, "time" should not be the only trigger for a DI job. Especially when file processing has to be performed in "near real time" AND the file delivery can't be pinned to a certain time, a "file exists" trigger is much better. Can that be done with Talend?
If so:
1. How?
2. What if the file is being delivered with its final name (instead of transfer with a temporary name and rename once the file has been fully transferred)? How does Talend make sure that the file is not being processed before it has been fully transferred?
3. Will such DI jobs run continuously? Or will they end after they processed one file?
Thanks
Matt
5 REPLIES
Seventeen Stars

Re: [resolved] DI job with "file exists" trigger?

hi,
have a look at tWaitForFile
https://help.talend.com/search/all?query=tWaitForFile&content-lang=en
regards
laurent
One Star

Re: [resolved] DI job with "file exists" trigger?

Oh, cool, thanks!
But what if 1 file has been delivered and the DI job has finished processing it? Will the DI job end? Or can a DI job be deployed in a way that it keeps watching the directory 24/7 and process every file that arrives when it arrives?
Thanks
Matt
Seventeen Stars

Re: [resolved] DI job with "file exists" trigger?

Select what to do with the iteration loop after the next component is triggered:
continue loop: continues iterating until the number of iterations reaches the defined maximum value.
exit loop: stops iterating immediately.

Smiley Wink
Seventeen Stars

Re: [resolved] DI job with "file exists" trigger?

have a look at Scenario 2 !
One Star

Re: [resolved] DI job with "file exists" trigger?

Thanks a lot :-)