One Star

Talend Admin jobs freeze after system restart

Hello,
The server machine which have Talend installed will automatically restart every month for maintenance. Whenever the machine restarts, some of the jobs in the Talend Admin get freeze and shows "1 Awaiting execution" while other jobs working fine. Each time different jobs get freezes.  I have tried stopping the job (clicked on the red symbol) but I can't able to resume/run the job. So each time I have to delete and re-create it. I have total 22 jobs running with frequency of every 20 seconds. 
I would like to know the cause for this issue. Do I need to follow up any steps before restarting the machine?
Configuration:
Talend 5.3.1.104014 Enterprise version
Tomcat 7
OS: Windows 2008 R2 Server, 16 GB RAM
Java: jdk1.6.0_45
Thanks,
Karthick
4 REPLIES
Moderator

Re: Talend Admin jobs freeze after system restart

Hi Karthick,
Is there any error log? which is located in <ServersInstallationPath>\apache-tomcat-\logs.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Talend Admin jobs freeze after system restart

Hi Karthick,
Is there any error log? which is located in <ServersInstallationPath>\apache-tomcat-\logs.
Best regards
Sabrina

Below is the log found in Apache/logs. Also I have attached the entire log file. log.txt.txt
2014-11-08 20:27:59 Commons Daemon procrun stdout initialized
2014-11-08 20:30:19 ERROR InstallUtil - Error in Initial data installation
java.lang.NullPointerException
at org.talend.gwtadministrator.server.scheduler.view.JobServerViewAdapter.gwt2Hib(JobServerViewAdapter.java:158)
at org.talend.gwtadministrator.server.scheduler.view.JobServerViewAdapter.gwt2Hib(JobServerViewAdapter.java:66)
at org.talend.gwtadministrator.server.AbstractViewAdapter.gwt2Hib(AbstractViewAdapter.java:73)
at org.talend.gwtadministrator.server.scheduler.view.JobServerViewAdapter.saveJobServer(JobServerViewAdapter.java:301)
at org.talend.gwtadministrator.server.remoteconnection.InstallUtil.configJobserver(InstallUtil.java:214)
at org.talend.gwtadministrator.server.remoteconnection.InstallUtil.install(InstallUtil.java:82)
at org.talend.administrator.core.TacApplicationInitializer.init(TacApplicationInitializer.java:77)
at org.talend.gwtadministrator.server.remoteconnection.InitServlet.init(InitServlet.java:34)
at javax.servlet.GenericServlet.init(GenericServlet.java:158)
at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1284)
at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1197)
at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1087)
at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:5210)
at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5493)
at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:632)
at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1229)
at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1875)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
2014-11-08 20:30:19 ERROR JDBCExceptionReporter - Table "QRTZ_CALENDARS" already exists; SQL statement:
CREATE TABLE QRTZ_CALENDARS (
  CALENDAR_NAME VARCHAR (200)  NOT NULL ,
  CALENDAR IMAGE NOT NULL
)
2014-11-08 20:30:21 WARN  NiceCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Nice CPU usage
2014-11-08 20:30:21 WARN  IdleCPUUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Idle CPU usage
2014-11-08 20:30:21 WARN  IdleCPUUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Idle CPU usage
2014-11-08 20:30:21 WARN  TotalCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Total CPU usage
2014-11-08 20:30:21 WARN  TotalCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Total CPU usage
2014-11-08 20:30:21 WARN  NiceCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Nice CPU usage
2014-11-08 20:30:21 WARN  TotalCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Total CPU usage
2014-11-08 20:30:21 WARN  NiceCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Nice CPU usage
2014-11-08 20:30:21 WARN  TotalCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Total CPU usage
2014-11-08 20:30:21 WARN  TotalCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Total CPU usage
2014-11-08 20:30:21 WARN  NiceCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Nice CPU usage
2014-11-08 20:30:21 WARN  IdleCPUUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Idle CPU usage
2014-11-08 20:30:21 WARN  NiceCpuUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Nice CPU usage
2014-11-08 20:30:21 WARN  IdleCPUUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Idle CPU usage
2014-11-08 20:30:21 WARN  IdleCPUUsageLimit - org/hyperic/sigar/SigarException
2014-11-08 20:30:21 ERROR RatedServer - Value not retrieved for Idle CPU usage
2014-11-08 20:31:43 WARN  VirtualServerJobDeployer - Error when 'Sending... caused by: JobServer 'localhost' (localhost:8001)
java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:43 ERROR RemoteTaskExecution - ###### Exception 'class org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException': executionTask.error.taskIsInProcessingState:ExecutionTask, contextParams=null]
org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
2014-11-08 20:31:43 ERROR RemoteExecutionSwitcher - ###### Unexpected exception on: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
org.quartz.JobExecutionException: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:388)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
... 4 more
2014-11-08 20:31:43 ERROR RemoteTaskExecution - ###### Exception 'class org.talend.administrator.scheduler.exception.ExecutionTaskException': G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied):ExecutionTask, contextParams=null]
org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:1045)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:43 ERROR RemoteExecutionSwitcher - ###### Unexpected exception on: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
org.quartz.JobExecutionException: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:392)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:1045)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
... 4 more
Caused by: java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_10\1411064602024_task_10-JobServer_1\PickedLicensePlates\pickedlicenseplates_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:45 ERROR RemoteTaskExecution - ###### Exception 'class org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException': executionTask.error.taskIsInProcessingState:ExecutionTask, contextParams=null]
org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
2014-11-08 20:31:45 ERROR RemoteExecutionSwitcher - ###### Unexpected exception on: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
org.quartz.JobExecutionException: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:388)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
... 4 more
2014-11-08 20:31:47 WARN  VirtualServerJobDeployer - Error when 'Sending... caused by: JobServer 'localhost' (localhost:8001)
java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:47 ERROR RemoteTaskExecution - ###### Exception 'class org.talend.administrator.scheduler.exception.ExecutionTaskException': G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied):ExecutionTask, contextParams=null]
org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:1045)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:47 ERROR RemoteExecutionSwitcher - ###### Unexpected exception on: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
org.quartz.JobExecutionException: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:392)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: org.talend.administrator.scheduler.exception.ExecutionTaskException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:1045)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
... 4 more
Caused by: java.io.FileNotFoundException: G:\Talend\5.3.1\tac\archive\jobs\task_12\1407177968356_task_12-JobServer_1\ReturnUpload_850\returnupload_850_0_1.jar (Access is denied)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zips(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zip(Unknown Source)
at org.talend.utils.io.FilesUtils.zipFolderRecursion(Unknown Source)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.readySend(VirtualServerJobDeployerCached.java:163)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployerCached$SenderThreadCached.send(VirtualServerJobDeployerCached.java:172)
at org.talend.administrator.scheduler.business.job.deploy.VirtualServerJobDeployer$SenderThread.run(VirtualServerJobDeployer.java:233)
2014-11-08 20:31:49 ERROR RemoteTaskExecution - ###### Exception 'class org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException': executionTask.error.taskIsInProcessingState:ExecutionTask, contextParams=null]
org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
2014-11-08 20:31:49 ERROR RemoteExecutionSwitcher - ###### Unexpected exception on: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
org.quartz.JobExecutionException: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:388)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.execute(RemoteTaskExecution.java:191)
at org.talend.administrator.scheduler.jobs.RemoteExecutionSwitcher.execute(RemoteExecutionSwitcher.java:50)
at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: org.talend.administrator.scheduler.exception.AlreadyTaskProcessingException: executionTask.error.taskIsInProcessingState
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.checkTaskAndResetErrorStatus(ExecutionTaskHandler.java:800)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeOperation(ExecutionTaskHandler.java:833)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.beforeRunTask(ExecutionTaskHandler.java:828)
at org.talend.administrator.scheduler.business.ExecutionTaskHandler.runTaskUnit(ExecutionTaskHandler.java:877)
at org.talend.administrator.scheduler.jobs.RemoteTaskExecution.executeRemoteJob(RemoteTaskExecution.java:348)
... 4 more
Five Stars

Re: Talend Admin jobs freeze after system restart

I have experienced the same, going back to version 4.x .  The jobs that are "frozen" are the ones that were running at the time TAC, jobserver were shut down.   If you have a planned shut down,  it's best to pause all jobs and kill any running ones (or wait for them to finish), prior to shutting down TAC, etc.   If it's an unexpected shutdown (server crash, etc), there's not much you can do except recreate the jobs, like you're doing.
Moderator

Re: Talend Admin jobs freeze after system restart

Hi cgvak,
Please report a ticket on Talend Support Portal so that we can give you a remote assistance through support cycle.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.