TfileList Multiple Files iterate into 1 inputdelimited

One Star

TfileList Multiple Files iterate into 1 inputdelimited

Hi,
I have 6 files in a folder with similar structure. I wan to copy data from all the files into 1 single file with some computation. I have created on tfilelist which point to a folders and used filemask *emp*.txt. How do I merge all this file into 1 tfileinputldelimited and use tmap for computation and tmap is then connected to 1 tfileoutputdelimited.

tfileist-->tfileinputldelimited -->tmap-->tfileoutputdelimited.
tfilelist will have multiple files
Regards
PB
One Star

Re: TfileList Multiple Files iterate into 1 inputdelimited

Hi
Does you have same computation in all the incoming files? if yes, make a temp input delimited file using tfilelist i.e. combaning all the input files into one
tFileList--iterate--tFileInputdelimited--->tFileoutputDelimited(temp file with append option checked to add data into the temp file)
Now use the temp file and do computation and save the output
tFileInputDelimited(temp file)---> tMap--->tFileOutputDelimited (Output File)
Highlighted
One Star

Re: TfileList Multiple Files iterate into 1 inputdelimited

if you dont want to create a temp file.
you can just select the "Append" check box in u r tfileoutputdelimited. and your design should be fine.
tfileist-->tfileinputldelimited -->tmap-->tfileoutputdelimited.

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.