I have a job that makes a download of folders and sub folders based on a variable that contains the current date.
Now, based on the current date, I want to download the same structure for each day based on a range of time.
E.g.: today is 2018/09/24 and I'm interested on the folders from today up to a week ago.
1) I start from today so I download all the folders (containing files) for 2018/09/24
2) yesterday was 2018/09/23 so I'll download all the related folders (and subfolders)
3) then the same as above but for the day before and so on until a week
I have the single job, how can I iterate it with a range of time?
I started evaluating the tForEach, but I'm not sure that is the right direction.
Any suggestion is appreciated.
hi navds, thank you for your hint. But my question would be: why and how to apply it?
This is the job flow I have in place with a short description:
I want to execute it n times, where n is equal to the number of days contained within a range of time. According to the example above, it would be 7 days. But in general it could be a month, or 2 weeks...
You just need to replace the tLogRow with tRunJob where you pass the date as context.
Try Talend Cloud free for 30 days.
Introduction to Talend Open Studio for Data Integration.
Practical steps to developing your data integration strategy.
Create systems and workflow to manage clean data ingestion and data transformation.