TAC / Job Server ignoring parallelization

One Star

TAC / Job Server ignoring parallelization

RT Big Data 6.3.1

  • Job properly runs with parallelization when ran on dev laptop, processing ~1000 files per minute.
  • Job properly runs with parallelization when remote ran on job server, processing ~1000 files per minute.
  • Job runs single threaded (ignores parallelization) when ran on TAC published to same job server, imported from zip built on laptop, processing ~1000 files per 16 hours.
  • Job runs single threaded (ignores parallelization) when ran on TAC published to same job server built on TAC via command line, processing ~1000 files per 16 hours.

TAC and job server are EC2 instances on AWS. RHEL OS. Job is functionally correct but seems to ignore parallelization when ran from TAC. We have stripped the job down to a bare minimum of three or four components to verify that anything ran or built on the TAC is ignoring parallelization. 

 

Any ideas?

 

Wayne

 

 

Community Manager

Re: TAC / Job Server ignoring parallelization

Hi
The job is also deployed to remote job server and executed on it when you run it from TAC. I want to know where/how do you configure the job to run with parallelization?

Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch