I wanted to copy certain folders from a FTP server to my local computer.
Here is the Talend components I used:
2. tFTPFileList -- with the filemask in tFTPFileList, I was able exclude some unwanted folders. In order to exclude all the unwanted files, I used another 2 components:
filename: ((String)globalMap.get("tFTPFileList_4_CURRENT_FILE")) -- in this case, the filename is the folder name
use a filter to exclude unwanted file: !row9.filename.equals("here is the unwanted folder name")
Now if I link tMap's output to tLogRow, I can see the unwanted filenames (folder names) are all gone.
But my question is, how to copy the correct foldes after tMap? Can I just connect tMap to tFTPGet? What should I do now?
Solved! Go to Solution.
@TigerMommy,from tMap,wirite it it file ,tHashOutput or DB and again read that file and iterate the values and in tFTPGet call that global variable form iterated value as file-mask.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Accelerate your data lake projects with an agile approach
Create systems and workflow to manage clean data ingestion and data transformation.