We have some jobs using Talend to upload files on FTP that have always been slow but we never took the time to investigate until today.
I saw (in the generated code as well as with Wireshark) that each time the tFTPPut component is called, it first starts with a directory listing.
That's a problem for us as the FTP destination directory is large with a lot of files. In consequence, for each uploaded file (50 kB for the biggest, 5kB for the smallest), there is a directory listing that took approximately 500 kB (between 10 and 100 times the size of the file send).
Any workaround to avoid a full directory listing for each file?
Tested on a very simple job:
tFileList->tFTPPut (using existing connection)
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema
Pick up some tips and tricks with Context Variables