I'm using tSSH component to call a spark-submit command and that works very well.
When the spark job is too long (> 30 minutes), the talend job keeps running while the spark job is already finished.
Is there any timeout to configure?
I am having the same issues with Spark 2.3, is your spark on the same version as I?
It was working like charm in Spark 2.1 by the way.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks