how to get file names from remote linux server using tFileList

Highlighted
One Star

how to get file names from remote linux server using tFileList

Hi All,
I am facing a problem which i can't solve out that's why looking for a suggestion. Any Suggestion would be appreciable.
Requirement--->>> Copy a List of files from remote server to local machine.
Scenario----->>> I have created a connection using tSCP_Get and then i am using tFileList to retrieve a set of file names using
"cd /my path/ *.tsv"
and then in tSCPGET component i am using ((String)globalMap.get("tSCPFileList_1_CURRENT_LINE")) to fetch the name of file and copy it to my local machine
PROBLEM-->> when i run this job
Starting job copy_files at 14:51 20/06/2013.

connecting to socket on port 3657
connected
Execution of cd is not allowed
Please log in and run the command interactively
disconnected
Job copy_files ended at 14:51 20/06/2013.
Highlighted
Moderator

Re: how to get file names from remote linux server using tFileList

Hi,
Please see the component reference tSCPGet with a scenario "Getting files from a remote SCP server".
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
One Star

Re: how to get file names from remote linux server using tFileList

In order to get files you need to use
                                                      tSCPFileList >>> tSCPGet
1) tSCPFileList_1 -> In the FileList  setting use something like "ls /home/username/*.tsv"
2) connect tSCPFileList_1 "iterate" to your tSCPGet_1
3) tSCPGet_1 -> a) local directory: is where you want the files to go into on your local machine
                       b) Filelist:  ((String)globalMap.get("tSCPFileList_1_CURRENT_LINE"))

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog