Reading file from remote server

One Star

Reading file from remote server

Hi,
We have a requirement to read the file from the Remote Server (Linux) and have to load them into the Target.
If am not wrong it can be established using FTP components. But the Limitation is I should not copy the File to the local directory. Is there any way to read the data from the file in remote server without copying them onto my local machine Inputs would be useful.
Thanks
Seventeen Stars

Re: Reading file from remote server

hi,
use buffer (tBufferOutput) to store in memory.
And read it later with tBufferInput.
as it store in memory adapt you jvm allocated memory to your need.
hope it helps
regards
laurent
One Star

Re: Reading file from remote server

Hi,
Thanks for the quick reply..
If the volume of data is less means we can go with that.
But in our case the volume of data is large.
So i fear JVM memory cant be changed to our need.
Thanks
One Star

Re: Reading file from remote server

Can you run your job on the remote server? What is your target?
One Star

Re: Reading file from remote server

I am also facing the same issue. My talend job has to read a file from unix server and load it into oracle database. Is there a way we can achieve this ? The file size in this case is big.
Five Stars

Re: Reading file from remote server

I too have similar kind of requirement reading file directly from remote. Appreciate if any suggestions 

Eleven Stars

Re: Reading file from remote server

Try below example with tfilefetch. Supports http, https, ftp and smb

https://help.talend.com/reader/jomWd_GKqAmTZviwG_oxHQ/wZphtUXJPNp32p65z7XSgQ?section=Raa47862
Regards
Abhishek KUMAR

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

APIs for Dummies

View this on-demand webinar about APIs....

Watch Now