tfileList iterate parallel execution

Highlighted
One Star

tfileList iterate parallel execution

I am using tFileList->Iterate->tFileInputDelimited->tmap->tmssqloutoutput

I enabled parallel execution on tIterate

It does not seem to be working . What is the best way to process files in parallel on tIterate?
Highlighted
Community Manager

Re: tfileList iterate parallel execution

Hi
Which version? I tested it on v412 and it works. see my screenshot.

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Highlighted
One Star

Re: tfileList iterate parallel execution

I am also 4.1.2

Scenario like yours works for me also

But in my job, i had enable parallel execution at the iterate level and also tmssqloutout component.

Is this supported? ( Enable parallel execution at multiple nodes)
Highlighted
Community Manager

Re: tfileList iterate parallel execution

Hi
yes, it is supported, what's your problem?

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Highlighted
One Star

Re: tfileList iterate parallel execution

It is working. But job is getting very slow

I need to check the performance issue on the mssql output

Thanks

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog

Downloads and Trials

Test drive Talend's enterprise products.

Downloads