tfileList iterate parallel execution

One Star

tfileList iterate parallel execution

I am using tFileList->Iterate->tFileInputDelimited->tmap->tmssqloutoutput

I enabled parallel execution on tIterate

It does not seem to be working . What is the best way to process files in parallel on tIterate?
Community Manager

Re: tfileList iterate parallel execution

Hi
Which version? I tested it on v412 and it works. see my screenshot.

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: tfileList iterate parallel execution

I am also 4.1.2

Scenario like yours works for me also

But in my job, i had enable parallel execution at the iterate level and also tmssqloutout component.

Is this supported? ( Enable parallel execution at multiple nodes)
Community Manager

Re: tfileList iterate parallel execution

Hi
yes, it is supported, what's your problem?

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: tfileList iterate parallel execution

It is working. But job is getting very slow

I need to check the performance issue on the mssql output

Thanks

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Have you checked out Talend’s 2019 Summer release yet?

Find out about Talend's 2019 Summer release

Blog

Talend Summer 2019 – What’s New?

Talend continues to revolutionize how businesses leverage speed and manage scale

Watch Now

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog