tFileFetch to get multiple XML files in multiple directories

One Star

tFileFetch to get multiple XML files in multiple directories

Im a novice to Talend but I'm starting to learn some things. I have a job setup to read XML files on my server and load them, what I need help with is pulling the files down from the web and storing them on my machine.
The XML files are in this directory structure:
http://www.banking/2012/09/01/bank.xml
http://www.banking/2012/09/01/banks/1001.xml
http://www.banking/2012/09/01/banks/1002.xml
http://www.banking/2012/09/02/bank.xml
http://www.banking/2012/09/01/banks/3452.xml
I think you get the idea.
I think I can use a tForEach to help do this but I don't know exactly how to set this up. Some of the XML file names are static while others are dynamic so that is another challenge. Any experts out there able to help out?
Thanks gang!
One Star

Re: tFileFetch to get multiple XML files in multiple directories

Does anyone have some thoughts on this problem? Thanks!
Community Manager

Re: tFileFetch to get multiple XML files in multiple directories

Hi
tFileFetch don't support a dynamic file name in URI field. You can consider to use FTP or SCP protocol to get the files.
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: tFileFetch to get multiple XML files in multiple directories

Thanks for the reply. I have tried to FTP to the website but that doesn't appear to work. I'm fairly certain the site is not setup to accept FTP Transfers. I'm going to look into SCP and see if that is successful.