Can anyone please advice how to get complete log that comes on console to a file in case of spark batch job?
Any help will be much appreciated.
Could you please have a look at this KB article about:https://community.talend.com/t5/Migration-Configuration-and/Cannot-Get-Talend-Spark-Job-Execution-Lo... to see if Spark History can meet your needs?
Here is online document about:TalendHelpCenter:Logging and checkpointing the activities of your Apache Spark Job.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Learn how to make your data more available, reduce costs and cut your build time
Read about OTTO's experiences with Big Data and Personalized Experiences
Take a look at this video about Talend Integration with Databricks