One Star

TAC / Job Server ignoring parallelization

RT Big Data 6.3.1

  • Job properly runs with parallelization when ran on dev laptop, processing ~1000 files per minute.
  • Job properly runs with parallelization when remote ran on job server, processing ~1000 files per minute.
  • Job runs single threaded (ignores parallelization) when ran on TAC published to same job server, imported from zip built on laptop, processing ~1000 files per 16 hours.
  • Job runs single threaded (ignores parallelization) when ran on TAC published to same job server built on TAC via command line, processing ~1000 files per 16 hours.

TAC and job server are EC2 instances on AWS. RHEL OS. Job is functionally correct but seems to ignore parallelization when ran from TAC. We have stripped the job down to a bare minimum of three or four components to verify that anything ran or built on the TAC is ignoring parallelization. 

 

Any ideas?

 

Wayne

 

 

1 REPLY
Community Manager

Re: TAC / Job Server ignoring parallelization

Hi
The job is also deployed to remote job server and executed on it when you run it from TAC. I want to know where/how do you configure the job to run with parallelization?

Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business