I have to process N number of files from directory and I have to do 2 files processing in parallel. How do I make sure that every time different files are picked up from directory for processing, when I process these files in parallel.
by Debug Run-->Traces Run.
@BN,in tFileList, you can specify filemask and get the n. number of files to iterate the next process by taking the global map current filename from tFileList.
If you use tFileList and iterate through each file, on the iterate connection between the tFileList and the next component, click the "Enable parallel execution" and set the number to 2.
For some reason my "Enable parallel execution" is greyed out. Have to check why.
Maybe check the job parameters tab, Extra, Multi thread execution.
Do we have any solution to this problem? I also want to process N files at the same time. So if the 1st file processing by the 1st subjob the second file should be processed by 2nd subjob and so on.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn about modern data engineering in the Cloud
Learn how to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud registries
Learn how to publish your API Services to Talend Cloud