Updated video is available for Databricks Runtime 11.3 and above - • Databricks Monitoring with Log Analyt...
Log Analytics provides a way to easily query logs and setup alerts in Azure. This provides a huge help when monitoring Apache Spark. In this video I walk through the setup steps and quick demo of this capability.
Written tutorial and troubleshooting steps:
https://dustinvannoy.com/2021/08/09/m...
More from Dustin:
Website: dustinvannoy.com
Twitter: @dustinvannoy
Github: https://github.com/datakickstart