I have a Spark job, which i can run it in Cluster using Spark submit command by calling the class name.
Now i'm trying to call the jar file from Talend tJava or Routine, but my question is Spark job was written in Scala object, so how to call the main method, if that's not possible what is the easiest way to call the spark job in a Jar from Talend.
We have redirected your issue to our Big data experts and will keep you posted.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks