I am trying to change the application name for a spark job created by talend BigData 6.4 version. But this approach is not working. I have seen posts where people change the application name using spark-submit. How do I do the same using talend tool.
If you are trying to change the name of Talend job, you can close the job and right click the job properties.
Or, are you trying something different?
I have attached the screen shot in the question.
Please open that and zoom it.
Dynamic change of talend job name or application name is explained in the following thread.
I want to do the same stuff in talend.
Hello @TomG ,
did you found a solution for your issue?
as I have one generic spark job, which is called as child job I would like to set Spark appname during runtime. so it would be possible to determine each execution in in spark history.
Talend Spark Job, sets AppName according sparkcontext as followed
sparkConfiguration.setAppName(projectName + "_" + jobName + "_" + jobVersion);
as I create a sparkSession in java-component I thought to test .appName()
have you tried this approach?
Try using "spark.app.name" property in the spark job-> Run-> Spark configuration-> Advanced Settings with the value you would like to set for the job.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Read about OTTO's experiences with Big Data and Personalized Experiences
Pick up some tips and tricks with Context Variables
Take a look at this video about Talend Integration with Databricks