How to get incremental files from same folder …in talend
I have to get files based on last job start date after which are files coming those files i need process..how i can achive help me..Thank you
Solved! Go to Solution.
Hi TRF, Thanks for your response....My requirement is incremental files are coming to client server from that we need process the those files, which are newly coming from last run..
Ex: Yesterday 10 files came ---> we processed--
today 5 files came ---->total 15(yesterday 10+today 5)--from this i want to get latest files and need to process..
How we can this?
Please share the complete Talend Design ?
Thank you so much
Hi Sir, Thank you for your response..but my client saying without achieve the files we need to process latest files based on last run
here is how to do that, we had same requirement on getting latest file from FTP,
basically we compare the files creation date & compare it with previous files creation date & that's how we basically sort the file & get latest file,
globalMap.get("sortedmtime") == null ? row1.mtime : (row1.mtime >= (long)globalMap.get("sortedmtime"))?row1.mtime:globalMap.get("sortedmtime")
There are so many other solution out there like using tbuffer to store all files & then use tSort to sort data