I have a job that makes a download of folders and sub folders based on a variable that contains the current date.
Now, based on the current date, I want to download the same structure for each day based on a range of time.
E.g.: today is 2018/09/24 and I'm interested on the folders from today up to a week ago.
1) I start from today so I download all the folders (containing files) for 2018/09/24
2) yesterday was 2018/09/23 so I'll download all the related folders (and subfolders)
3) then the same as above but for the day before and so on until a week
I have the single job, how can I iterate it with a range of time?
I started evaluating the tForEach, but I'm not sure that is the right direction.
Any suggestion is appreciated.
hi navds, thank you for your hint. But my question would be: why and how to apply it?
This is the job flow I have in place with a short description:
I want to execute it n times, where n is equal to the number of days contained within a range of time. According to the example above, it would be 7 days. But in general it could be a month, or 2 weeks...
You just need to replace the tLogRow with tRunJob where you pass the date as context.
Join us at the Community Lounge.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Take a look at this video about Talend Integration with Databricks
Learn how<SPAN>to modernize your Cloud Platform for Big Data Analytics with Talend and Microsoft Azure</SPAN>