How to use tS3Get to copy entire S3 folder?

Four Stars

How to use tS3Get to copy entire S3 folder?

Hi,

I am have a requirement where I need to copy s3 folder to local.

 

I am currently using tS3fileList to list all the files in S3 source folder and then iterate through each of the file to copy it to local using tS3get. 

 

Is there option in tS3Get to copy entire S3 folder to local, instead of copying file by file?

Something similar to command below.

aws s3 cp s3://bucketName/SourceFolder Localfolder/ 

Highlighted
Moderator

Re: How to use tS3Get to copy entire S3 folder?

Hello,

So far, there is no option that copying entire S3 folder to local.

You can use thiswork flow tS3Connection-->tS3List-->iterate-->tS3Get to get entire S3 path.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog