Loading all files into S3

Highlighted
Eight Stars

Loading all files into S3

I am trying to load all files (example 4 files in a folder )in the folder into S3 as below , but it is only loading the last file as 4 times into the s3 . How can i achieve loading all 4 different files into the S3 

1.PNG

 

 

 


Accepted Solutions
Highlighted
Employee

Re: Loading all files into S3

@Karuetl , why dont you link tFilelist->iterate->tS3Put (use file name of tfilelist variable in tS3Put dynamically) .I dont see any value addition of 3 iterate links (loop under loop under loop) ..not required.

View solution in original post


All Replies
Highlighted
Sixteen Stars
Sixteen Stars

Re: Loading all files into S3

Hi,
Because tJava is executed first and only once for the subjob. So, based on your job design, this is a normal behaviour.
Can you detail the steps you try to achieve with this job?

TRF
Highlighted
Employee

Re: Loading all files into S3

@Karuetl , why dont you link tFilelist->iterate->tS3Put (use file name of tfilelist variable in tS3Put dynamically) .I dont see any value addition of 3 iterate links (loop under loop under loop) ..not required.

View solution in original post

Highlighted
Eight Stars

Re: Loading all files into S3

Yes i have used logic as  tFilelist->iterate->tS3Put 

 

Thanks all 

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog