We are seeing a strange issue where we can compile and run a job successfully in Studio (6.5.1) but the job won't publish to Nexus from TAC. Here is the error:
Publish failed: org.talend.designer.runprocess.ProcessorException: org.talend.commons.exception.PersistenceException: org.talend.designer.runprocess.ProcessorException: Job compile errors
At least job "util_cda_dataproc" has a compile errors, please fix and export again.
Error Line: 691
Detail Message: The method withTags(List<String>) is undefined for the type DataprocCreateCluster.Builder
There may be some other errors caused by JVM compatibility. Make sure your JVM setup is similar to the studio.
Note that util_cda_dataproc is a child job being invoked from the parent job. If we try and publish the child job to Nexus by itself, it is successfully published. Any ideas?
Could you please toggle to code section of the parent job and verify whether it is showing any errors there?
Both parent and child jobs show no errors when viewing the code section.
More information... It appears that we are able to run the job via Studio to a jobserver. However when we attempt to do a BUILD, either from Studio or TAC, we get the error indicated.
The parent job has a child job (via tRunJob) to start a DataProc cluster, and another tRunJob to submit a spark job to the cluster.
Since the job is running fine when you are executing through Studio remote mode, the issue might be during the library packaging during build for TAC.
Could you please advise whether you are using any third party libraries in your job? It would be great if you could share the job flow screenshots of both parent and child jobs along with component screenshot of Data proc connectivity (after masking sensitive information).
Not using third party libraries as far as I know. I am going to open a case as well, but wanted to check here first to see if this is something that others have experienced. I'll report back when I have a resolution from support.
There is no any missing library in the CommandLine?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Take a look at this video about Talend Integration with Databricks
Learn how<SPAN>to modernize your Cloud Platform for Big Data Analytics with Talend and Microsoft Azure</SPAN>