tSSH component is not ending and keeps on running when executing spark-submit

Highlighted
Four Stars

tSSH component is not ending and keeps on running when executing spark-submit

Hello,

 

I'm using tSSH component to call a spark-submit command and that works very well.

When the spark job is too long (> 30 minutes), the talend job keeps running while the spark job is already finished.

Is there any timeout  to configure?

 

Thanks

Four Stars

Re: tSSH component is not ending and keeps on running when executing spark-submit

Please, can i get some help?

Four Stars

Re: tSSH component is not ending and keeps on running when executing spark-submit

Hello, nobody can help me to resolve this problem?

Four Stars

Re: tSSH component is not ending and keeps on running when executing spark-submit

Any help please ???

Six Stars

Re: tSSH component is not ending and keeps on running when executing spark-submit

Hello,

 

I am having the same issues with Spark 2.3, is your spark on the same version as I?

It was working like charm in Spark 2.1 by the way.

 

Regards,

MC Lee

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now