I am have a requirement where I need to copy s3 folder to local.
I am currently using tS3fileList to list all the files in S3 source folder and then iterate through each of the file to copy it to local using tS3get.
Is there option in tS3Get to copy entire S3 folder to local, instead of copying file by file?
Something similar to command below.
aws s3 cp s3://bucketName/SourceFolder Localfolder/
So far, there is no option that copying entire S3 folder to local.
You can use thiswork flow tS3Connection-->tS3List-->iterate-->tS3Get to get entire S3 path.
Watch the recorded webinar!
Accelerate your data lake projects with an agile approach
Create systems and workflow to manage clean data ingestion and data transformation.
Introduction to Talend Open Studio for Data Integration.