How to capture stats and logs in Big data jobs in files.

Five Stars

How to capture stats and logs in Big data jobs in files.

I want to capture the stats and log in Big data job like we do in standard job.

I could not see stat and log option in big data job , is there any other way to capture the details ?

 

Thanks,

Manish

 

Moderator

Re: How to capture stats and logs in Big data jobs in files.

Hello,

Could you please take a look at this Spark History section TalendHelpCenter:Logging and checkpointing the activities of your Apache Spark Job to see if it is what you are looking for?

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.