Skip to content

Latest commit

 

History

History
50 lines (30 loc) · 2.26 KB

File metadata and controls

50 lines (30 loc) · 2.26 KB
title How to monitor Apache Spark applications in Synapse Studio
description Learn how to monitor your Apache Spark applications by using Synapse Studio.
author gillharmeet
ms.service azure-synapse-analytics
ms.topic how-to
ms.subservice monitoring
ms.date 11/30/2020
ms.author harmeetgill
ms.reviewer mahi

Monitor your Apache Spark applications in Synapse Studio

With Azure Synapse Analytics, you can use Apache Spark to run notebooks, jobs, and other kinds of applications on your Apache Spark pools in your workspace.

This article explains how to monitor your Apache Spark applications, allowing you to keep an eye on the latest status, issues, and progress.

Access Apache Spark applications list

To see the list of Apache Spark applications in your workspace, first open the Synapse Studio and select your workspace.

Log in to workspace

Once you've opened your workspace, select the Monitor section on the left.

Select Monitor hub

Select Apache Spark applications to view the list of Apache Spark applications.

Select Spark applications

Filter your Apache Spark applications

You can filter the list of Apache Spark applications to the ones you're interested in. The filters at the top of the screen allow you to specify a field on which you'd like to filter.

For example, you can filter the view to see only the Apache Spark applications that contain the name "sales":

Sample filter

View details about a specific Apache Spark application

To view the details about one of your Apache Spark applications, select the Apache Spark application and view the details. If the Apache Spark application is still running, you can monitor the progress. Read more.

Next steps

For more information on monitoring pipeline runs, see the Monitor pipeline runs Synapse Studio article.

For more information on debugging Apache Spark application, see the Monitor Apache Spark applications on Synapse Studio article.