Spark Batch Job Error in Code Section

Four Stars

Spark Batch Job Error in Code Section

Hello 

 

I have an issue while connecting my Spark Batch Job to Spark in Standalone mode. I see a lot of compilation errors generated for import package statements for hadooop and spark.

Attached are screen shots and job zip file.

code.JPGjob.JPGconfiguration.JPG 

Employee

Re: Spark Batch Job Error in Code Section

Select proper distribution which support Standalone mode, it will not give any compilation error. Check below screenshot

spark_standalone.JPGspark_standalone_1.JPG

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.