how to get file names from remote linux server using tFileList

One Star

how to get file names from remote linux server using tFileList

Hi All,
I am facing a problem which i can't solve out that's why looking for a suggestion. Any Suggestion would be appreciable.
Requirement--->>> Copy a List of files from remote server to local machine.
Scenario----->>> I have created a connection using tSCP_Get and then i am using tFileList to retrieve a set of file names using
"cd /my path/ *.tsv"
and then in tSCPGET component i am using ((String)globalMap.get("tSCPFileList_1_CURRENT_LINE")) to fetch the name of file and copy it to my local machine
PROBLEM-->> when i run this job
Starting job copy_files at 14:51 20/06/2013.

connecting to socket on port 3657
connected
Execution of cd is not allowed
Please log in and run the command interactively
disconnected
Job copy_files ended at 14:51 20/06/2013.
Moderator

Re: how to get file names from remote linux server using tFileList

Hi,
Please see the component reference tSCPGet with a scenario "Getting files from a remote SCP server".
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: how to get file names from remote linux server using tFileList

In order to get files you need to use
                                                      tSCPFileList >>> tSCPGet
1) tSCPFileList_1 -> In the FileList  setting use something like "ls /home/username/*.tsv"
2) connect tSCPFileList_1 "iterate" to your tSCPGet_1
3) tSCPGet_1 -> a) local directory: is where you want the files to go into on your local machine
                       b) Filelist:  ((String)globalMap.get("tSCPFileList_1_CURRENT_LINE"))

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download