Four Stars

Unable to invoke spark jobs through talend while connecting to EMR

Hi

 

We are unable to submit spark batch job through Talend Sandbox VM.

Below is the snapshot of the configuration setting for Spark batch job. I have also attached the error snapshots received. Kindly revert if I have missed anything in configuration.

Job configuration.pngSpark Confirgurationyarnerror.pngYarn errorRunjob.pngRun Job

1 REPLY
Employee

Re: Unable to invoke spark jobs through talend while connecting to EMR

Can you start your job with localhost first, it make sure your job has no other issues.

 

If that works, check connectivity between your studio to Hadoop enviornment , i am assuming you are running remotehost as localhost..

 

Increase the log4J to debug mode & share the log..