Five Stars

Get spark batch job log in file

Hi ,

 

Can anyone please advice how to get complete log that comes on console to a file in case of spark batch job?

Any help will be much appreciated.

 

Thanks

Tags (2)
1 REPLY
Moderator

Re: Get spark batch job log in file

Hi,

Could you please have a look at this KB article about:https://community.talend.com/t5/Migration-Configuration-and/Cannot-Get-Talend-Spark-Job-Execution-Lo... to see if Spark History can meet  your needs?

Here is online document about:TalendHelpCenter:Logging and checkpointing the activities of your Apache Spark Job.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.