how to call spark job as a jar from Talend

Five Stars

how to call spark job as a jar from Talend

I have a Spark job, which i can run it in Cluster using Spark submit command by calling the class name.

 

Now i'm trying to call the jar file from Talend tJava or Routine, but my question is Spark job was written in Scala object, so how to call the main method, if that's not possible what is the easiest way to call the spark job in a Jar  from Talend.

Moderator

Re: how to call spark job as a jar from Talend

Hello,

We have redirected your issue to our Big data experts and will keep you posted.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Seven Stars

Re: how to call spark job as a jar from Talend

did you get the solution?
Four Stars

Re: how to call spark job as a jar from Talend

Hi Team,

 

We have also similar issue.

Let us know the outcome

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now