CPU usage while running talend project

Six Stars

CPU usage while running talend project

Hi All,

 

We are facing issue while running one specific project the cpu usage comes up to 100% and it doesnt comes down until the job completes execution.

Can anyone please let me know the reason behind this and help me with it?

 

Thanking you in advance.

Tags (2)
Seven Stars

Re: CPU usage while running talend project

This is probably caused by the components in the project.

 

Can you post a screenshot of the job, so we can help you?

-----------------------------------------------------------------------------------------------------------
When you like my answer, please accept it as solution and send some kudos
Five Stars

Re: CPU usage while running talend project

From our experience, on a windows server, with some jobs I'd suggest that you look in Task Manager and see if it is one of the java processes taking all the CPU. If it is then increase the java memory for the specific job. We found that some 'bounced the limit' and then started to hog CPU but giving them a bit more java memory enabled them to run very quickly and not hog CPU.
We do have a revisit to the jobs on the 'to do' list to see if we can reduce the amount of memory they need but the 'instant' fix is more java memory for the 'problem' jobs.

Six Stars

Re: CPU usage while running talend project

Thanks saukema and Bill_Lane,

 

Yes this might be the case as we have not tried by increasing the memory .

 

But the job also hangs to execute Can that be the case for the same?

 

Five Stars

Re: CPU usage while running talend project

Sorry Pooja_kataria I'm not sure what you mean by 'hangs to execute'. I suspect it is a translation issue.

Highlighted
Six Stars

Re: CPU usage while running talend project

Hi Bill_Lane,

 

I meant sometimes the job while running as  standalone job hangs in between and doesnt process further. Due to which the CPU usage goes 100% and also one thing is we have used parallel execution in the job.Let me know if you still confused with my question

 

 

Thanks !

Five Stars

Re: CPU usage while running talend project

Ah right, when the Java memory is too small we think, that Talend starts paging the memory and seems to tie its self up in doing that while doing very little of the job and using 100% cpu. As I say, for us, in these cases just using the 'JVM Parameters' tab for the job and adding '-Xmx####M', where #### is the amount of memory in mega bites to add, fixes the issue. As far as we can tell this happens for us when the job retrieves a large amount of data and then has to do some other processing with the data. Our DB is on another machine.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

An API-First Approach to Modernizing Applications

Learn how to use an API-First Approach to Modernize your Applications

Watch Now

Talend API Designer – Technical Overview

Take a look at this technical overview video of Talend API Designer

Watch Now

Getting Started with APIs

Find out how to get started with APIs

Read