How to run a job in parallel multiple times in a job server

Six Stars

How to run a job in parallel multiple times in a job server

I need to run a job ( normal job  not spark)  multiple times for load test  from  job server  .  i need to pass multiple input values for each run. how to achieve this . i saw option in TAC but not seen how to pass multiple input values for each task. lets say input file type is finance*, corp*, etc..

 

 

 

Nine Stars

Re: How to run a job in parallel multiple times in a job server

Hi,

 

Are you trying to pass input file name like finance , corp and process files with name finance, corp etc.. ?

 

Please try below.

Create file with filename :

key;value
FileType;finance
FileType;corp

 

Then pass these values to tFlowToiterate , Then use tFileList and use global variable as file mask.

 

Fileiterate.PNG

Regards, 

 

Veeru Boppudi
Six Stars

Re: How to run a job in parallel multiple times in a job server

Hi Veera,

 

Thank you. if i want to test this  from job server . can you give me sample how to run job after i extract the  source zip file . This is for POC so trying options how to run from job server directly with multiple tasks same jobs.

 

job.sh < input 1>

job.sh <input 2>

...

..

 

 

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.

Download

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads