How to move files from S3 to HDFS using Talend?

Four Stars

How to move files from S3 to HDFS using Talend?

Hi All,

 

In our project, we have requirement to move a csv files from S3 to HDFS using Talend. We would like to avoid moving to local and directly copy the files from Amazon S3 to EMR - Hadoop HDFS files. Please let us know if this is possible using Talend.

 

Thanks
Sudhar


Accepted Solutions
Moderator

Re: How to move files from S3 to HDFS using Talend?

Hello,

So far, talend don't support for transferring data by air.

You have to get your data from S3 server (tS3Get component)to local firstly and then write your data into HDFS.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

All Replies
Moderator

Re: How to move files from S3 to HDFS using Talend?

Hello,

So far, talend don't support for transferring data by air.

You have to get your data from S3 server (tS3Get component)to local firstly and then write your data into HDFS.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.