Have you had issues with diagnosing cost and performance issues on Spark? Fear not, a document by Peter Stern, a Specialist Solutions Architect at Databricks, goes over this in detail. Watch this video to learn different ways to debug issues on Spark + Databricks.
►[Documentation] Learn more about diagnosing cost and performance issues using the Spark UI here - https://docs.databricks.com/en/optimizations/spark-ui-guide/index.html
►[Community feed] Read more from the author here - https://community.databricks.com/t5/technical-blog/mastering-the-spark-ui/ba-p/66315
►[Product] Learn more about Databricks here - https://www.databricks.com/
►Learn/connect with the speaker here - https://www.linkedin.com/in/peterst28/
► Discover more about Databricks in the Skill Builder Series here - https://www.youtube.com/playlist?list=PLeK0Tsm_E67QFwU4trdGZSjcQiTbcsBoz
#databricks # lakehouse #dataintelligence #spark #sparkui #cost #performance #debug #troubleshooting #bestpractices #documentation #guide
Download
0 formats
No download links available.
Mastering the SparkUI on Databricks 2024.04.30 | NatokHD