how to process multiple csv files using single tfilelist component in talend?

Five Stars

how to process multiple csv files using single tfilelist component in talend?

Hi Team,

I have a scenario where I have two different set of continous csv files with different metadata for emp and dept files. The file names will be (emp_1.csvemp_2.csv..... emp_10.csv) and  (dept_1.csv,dept_2.csv, dept_3.csv).Both the set of files are in same folder

Is it possible to process both the set of files using single tfilelist component or i should use two different flows with two tfilelist components each for emp and dept.

 

tfilelist -> tfileinputdelimited -> tmap -> tDBOutput ( is this correct to process both set of files)

Or is there any other way to achieve this.??

 

Could anyone reply asap?

 

Thanks,

Kiran Kumar

Eleven Stars

Re: how to process multiple csv files using single tfilelist component in talend?

1)

after iterator link use dummy tJava and then two run if based on file name

 

 

2) use dynamic schema if there is no transformation before load.tDboutout change table name based on file name

Regards
Abhishek KUMAR

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Why Companies Move to the Cloud: 7 Success Stories

Learn how and why companies are moving to the Cloud

Read Now