How to get utilization(cpu,memory) report of Adb cluster

Question

I have three clusters in adb i need its utilization report how can i get that

Answer 1

Hello @Aetemaad Hussain

Thanks for the question and using MS Q&A platform.

View compute metrics This article explains how to use the native compute metrics tool in the Azure Databricks UI to gather key hardware and Spark metrics. The metrics UI is available for all-purpose and jobs compute.

To get the CPU and memory utilization report for your Azure Databricks (ADB) clusters, you can use the native compute metrics tool available in the Azure Databricks UI. Here are the steps to access and view these metrics:

• Access Compute Metrics UI - Go to your Azure Databricks workspace. Click on Compute in the sidebar. Select the cluster you want to view metrics for. Click on the Metrics tab.
• View Hardware Metrics - By default, the Metrics tab shows hardware metrics, including CPU and memory utilization. You can filter metrics by time period using the date picker filter to view historical data.
• View Metrics at the Node Level - You can view metrics for individual nodes by selecting the node from the Compute drop-down menu.
• Using System Tables - Azure Databricks also provides system tables that capture utilization metrics for your clusters. You can query these tables to get detailed reports on CPU and memory usage.

For more details refer to this documentation: View compute metrics

Hope this helps. Do let us know if you have any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.