Reading file from remote server

One Star

Reading file from remote server

Hi,
We have a requirement to read the file from the Remote Server (Linux) and have to load them into the Target.
If am not wrong it can be established using FTP components. But the Limitation is I should not copy the File to the local directory. Is there any way to read the data from the file in remote server without copying them onto my local machine Inputs would be useful.
Thanks
Seventeen Stars

Re: Reading file from remote server

hi,
use buffer (tBufferOutput) to store in memory.
And read it later with tBufferInput.
as it store in memory adapt you jvm allocated memory to your need.
hope it helps
regards
laurent
One Star

Re: Reading file from remote server

Hi,
Thanks for the quick reply..
If the volume of data is less means we can go with that.
But in our case the volume of data is large.
So i fear JVM memory cant be changed to our need.
Thanks
One Star

Re: Reading file from remote server

Can you run your job on the remote server? What is your target?
One Star

Re: Reading file from remote server

I am also facing the same issue. My talend job has to read a file from unix server and load it into oracle database. Is there a way we can achieve this ? The file size in this case is big.
Four Stars

Re: Reading file from remote server

I too have similar kind of requirement reading file directly from remote. Appreciate if any suggestions 

Nine Stars

Re: Reading file from remote server

Try below example with tfilefetch. Supports http, https, ftp and smb

https://help.talend.com/reader/jomWd_GKqAmTZviwG_oxHQ/wZphtUXJPNp32p65z7XSgQ?section=Raa47862
Regards
Abhishek KUMAR

What’s New for Talend Spring ’19

Join us live for a sneak peek!

Sign up now

Agile Data lakes & Analytics

Accelerate your data lake projects with an agile approach

Watch

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch