Four Stars

How to move files from S3 to HDFS using Talend?

Hi All,

 

In our project, we have requirement to move a csv files from S3 to HDFS using Talend. We would like to avoid moving to local and directly copy the files from Amazon S3 to EMR - Hadoop HDFS files. Please let us know if this is possible using Talend.

 

Thanks
Sudhar

1 ACCEPTED SOLUTION

Accepted Solutions
Moderator

Re: How to move files from S3 to HDFS using Talend?

Hello,

So far, talend don't support for transferring data by air.

You have to get your data from S3 server (tS3Get component)to local firstly and then write your data into HDFS.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
1 REPLY
Moderator

Re: How to move files from S3 to HDFS using Talend?

Hello,

So far, talend don't support for transferring data by air.

You have to get your data from S3 server (tS3Get component)to local firstly and then write your data into HDFS.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.