Able to compile and run job from Studio but fails to publish from TAC

Highlighted
Six Stars

Able to compile and run job from Studio but fails to publish from TAC

Hi,

We are seeing a strange issue where we can compile and run a job successfully in Studio (6.5.1) but the job won't publish to Nexus from TAC.  Here is the error:

 

Publish failed: org.talend.designer.runprocess.ProcessorException: org.talend.commons.exception.PersistenceException: org.talend.designer.runprocess.ProcessorException: Job compile errors
At least job "util_cda_dataproc" has a compile errors, please fix and export again.
Error Line: 691
Detail Message: The method withTags(List<String>) is undefined for the type DataprocCreateCluster.Builder
There may be some other errors caused by JVM compatibility. Make sure your JVM setup is similar to the studio.

 

Note that util_cda_dataproc is a child job being invoked from the parent job.  If we try and publish the child job to Nexus by itself, it is successfully published.  Any ideas?

 

Thanks,

Phil

Employee

Re: Able to compile and run job from Studio but fails to publish from TAC

Hi,

 

    Could you please toggle to code section of the parent job and verify whether it is showing any errors there?

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: Able to compile and run job from Studio but fails to publish from TAC

Both parent and child jobs show no errors when viewing the code section.  

 

More information... It appears that we are able to run the job via Studio to a jobserver.  However when we attempt to do a BUILD, either from Studio or TAC, we get the error indicated.

 

The parent job has a child job (via tRunJob) to start a DataProc cluster, and another tRunJob to submit a spark job to the cluster.

 

Thanks,

Phil

Employee

Re: Able to compile and run job from Studio but fails to publish from TAC

Hi,

 

    Since the job is running fine when you are executing through Studio remote mode, the issue might be during the library packaging during build for TAC. 

 

    Could you please advise whether you are using any third party libraries in your job? It would be great if you could share the job flow screenshots of both parent and child jobs along with component screenshot of Data proc connectivity (after masking sensitive information).

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: Able to compile and run job from Studio but fails to publish from TAC

Not using third party libraries as far as I know.  I am going to open a case as well, but wanted to check here first to see if this is something that others have experienced.  I'll report back when I have a resolution from support.

 

Thanks,

Phil

Moderator

Re: Able to compile and run job from Studio but fails to publish from TAC

Hello,

There is no any missing library in the CommandLine?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now