Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
msprog
Contributor

SparkUI equivalent in Fabric

HI team,

is there a equivalaent of SparkUI in Microsoft Fabric? we are running pyspark notebooks and wanted to know if there is something like the SparkUI that gives insights into the execution plan, performance  etc.  

 

please let me know

 

thanks

1 ACCEPTED SOLUTION
nilendraFabric
Honored Contributor

Hello @msprog 

While Fabric doesn't have a direct equivalent named "Spark UI," you can access the Spark UI for a specific job or stage from within the notebook by selecting the link on the job or stage name. This provides detailed insights into the execution plan and performance metrics similar to Spark UI



https://learn.microsoft.com/en-us/fabric/data-engineering/spark-monitor-debug

https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook

Monitor Hub serves as a centralized portal for browsing Spark activities across items. You can view in-progress Spark applications, search and filter them based on different criteria, and drill down to view more execution details


View solution in original post

4 REPLIES 4
nilendraFabric
Honored Contributor

Hello @msprog 

While Fabric doesn't have a direct equivalent named "Spark UI," you can access the Spark UI for a specific job or stage from within the notebook by selecting the link on the job or stage name. This provides detailed insights into the execution plan and performance metrics similar to Spark UI



https://learn.microsoft.com/en-us/fabric/data-engineering/spark-monitor-debug

https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook

Monitor Hub serves as a centralized portal for browsing Spark activities across items. You can view in-progress Spark applications, search and filter them based on different criteria, and drill down to view more execution details


v-prasare
Honored Contributor II

@msprogAs we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

 

@nilendraFabric , Thanks for your promt response

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

v-prasare
Honored Contributor II

@msprog, As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

 

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

v-prasare
Honored Contributor II

@msprog, As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for your issue worked? or let us know if you need any further assistance here?

 

 

 

Thanks,

Prashanth Are

MS Fabric community support

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and give Kudos if helped you resolve your query

Helpful resources

Announcements
Users online (27)