Unable to invoke spark jobs through talend while connecting to EMR

Four Stars

Unable to invoke spark jobs through talend while connecting to EMR

Hi

 

We are unable to submit spark batch job through Talend Sandbox VM.

Below is the snapshot of the configuration setting for Spark batch job. I have also attached the error snapshots received. Kindly revert if I have missed anything in configuration.

Job configuration.pngSpark Confirgurationyarnerror.pngYarn errorRunjob.pngRun Job

Employee

Re: Unable to invoke spark jobs through talend while connecting to EMR

Can you start your job with localhost first, it make sure your job has no other issues.

 

If that works, check connectivity between your studio to Hadoop enviornment , i am assuming you are running remotehost as localhost..

 

Increase the log4J to debug mode & share the log..

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now