Four Stars

what is the max parallelize buffer size in talend job

i am running talend jobs parallel. what is the max parallelize buffer size in talend defaulte value is 25000 ,can we increase this number to how much?
2 REPLIES
Moderator

Re: what is the max parallelize buffer size in talend job

Hi,
The unit is a row. Every row is pushed in a buffer, when this size is reached: 
- the buffer is sent to a new worker thread to process it 
- the operation continue filling a new buffer

This is the size of each bucket of data. Best values depends on your machine / jobs. 


Best regards


Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: what is the max parallelize buffer size in talend job

hi xdshi,
          can you please give sample statistics on how to change these values depending on job,machine.