Merge pull request #269568 from v-thepet/stream-monitor

Azure Monitor horizontals - Stream Analytics

Author: denrea

articles/stream-analytics/TOC.yml

@@ -235,8 +235,6 @@
       href: geo-redundancy.md
     - name: Encrypt your data (CMK)
       href: data-protection.md
-    - name: Configure alerts
-      href: stream-analytics-set-up-alerts.md
   - name: Manage Stream Analytics clusters
     items:
     - name: Create and delete private endpoints
@@ -335,6 +333,10 @@
       href: stream-analytics-monitor-and-manage-jobs-use-powershell.md
     - name: Monitor jobs - Azure .NET SDK
       href: stream-analytics-monitor-jobs.md
+    - name: Configure alerts
+      href: stream-analytics-set-up-alerts.md
+    - name: Use activity and resource logs
+      href: stream-analytics-job-diagnostic-logs.md
   - name: Optimize jobs
     items:
     - name: Job simulation
@@ -419,8 +421,6 @@
       href: stream-analytics-troubleshoot-query.md
     - name: Watermark delay increase
       href: stream-analytics-job-analysis-with-metric-dimensions.md
-    - name: Activity and resource logs
-      href: stream-analytics-job-diagnostic-logs.md
     - name: Data errors
       href: data-errors.md
     - name: Error codes

articles/stream-analytics/includes/resource-logs-schema.md

@@ -4,7 +4,7 @@ description: include file
 author: spelluru
 ms.service: stream-analytics
 ms.topic: include
-ms.date: 07/10/2023
+ms.date: 03/20/2024
 ms.author: spelluru
 ms.custom: "include file"
 
@@ -27,7 +27,7 @@ properties | Log entry-specific detail, serialized as a JSON string. For more in
 
 Execution logs have information about events that happened during Stream Analytics job execution. The schema of properties varies depending on whether the event is a data error or a generic event.
 
-### Data errors
+#### Data errors
 
 Any error that occurs while the job is processing data is in this category of logs. These logs most often are created during data read, serialization, and write operations. These logs don't include connectivity errors. Connectivity errors are treated as generic events. You can learn more about the cause of various different [input and output data errors](../data-errors.md).
 
@@ -48,7 +48,7 @@ Depending on the **operationName** value, data errors have the following schema:
 
 * **Send events** occur during write operations. They identify the streaming event that caused the error.
 
-### Generic events
+#### Generic events
 
 Generic events cover everything else.
 
@@ -59,8 +59,5 @@ Message| Log message.
 Type | Type of message. Maps to internal categorization of errors. For example, **JobValidationError** or **BlobOutputAdapterInitializationFailure**.
 Correlation ID | GUID that uniquely identifies the job execution. All execution log entries from the time the job starts until the job stops have the same **Correlation ID** value.
 
-For reference, see a list of [all resource logs category types supported in Azure Monitor](/azure/azure-monitor/platform/resource-logs-schema). Select the link in the following table to see all the resource log category types collected for Azure Stream Analytics.  
+For reference, see a list of [all resource logs category types supported in Azure Monitor](/azure/azure-monitor/platform/resource-logs-schema) or [all the resource log category types collected for Azure Stream Analytics](../monitor-azure-stream-analytics-reference.md#resource-logs).
 
-|Resource Log Type | Resource Provider / Type Namespace<br/> and link to individual metrics |
-|-------|-----|
-| Stream Analytics streaming jobs | [Microsoft.StreamAnalytics/streamingjobs](/azure/azure-monitor/platform/resource-logs-categories#microsoftstreamanalyticsstreamingjobs) |

articles/stream-analytics/monitor-azure-stream-analytics-reference.md

@@ -1,66 +1,63 @@
 ---
-title: Monitoring Azure Stream Analytics data reference
-description: Important reference material needed when you monitor Azure Stream Analytics
-author: xujxu
-ms.author: xujiang1
+title: Monitoring data reference for Azure Stream Analytics
+description: This article contains important reference material you need when you monitor Azure Stream Analytics.
+ms.date: 03/21/2024
+ms.custom: horz-monitor
+ms.topic: reference
+author: spelluru
+ms.author: spelluru
 ms.service: stream-analytics
-ms.topic: how-to
-ms.date: 07/10/2023
 ---
 
-# Monitoring Azure Stream Analytics data reference
-This article provides a reference of log and metric data collected to analyze the performance and availability of Azure Stream Analytics jobs. See [Monitoring Azure Stream Analytics](monitor-azure-stream-analytics.md) for details on collecting and analyzing monitoring data for Azure Stream Analytics.
+# Azure Stream Analytics monitoring data reference
 
-## Metrics
+[!INCLUDE [horz-monitor-ref-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-intro.md)]
 
-This section lists all the automatically collected platform metrics collected for Azure Stream Analytics.  
+See [Monitor Azure Stream Analytics](monitor-azure-stream-analytics.md) for details on the data you can collect for Azure Stream Analytics and how to use it.
 
-|Metric Type | Resource Provider / Type Namespace<br/> and link to individual metrics |
-|-------|-----|
-| Stream Analytics streaming jobs | [Microsoft.StreamAnalytics/streamingjobs](/azure/azure-monitor/platform/metrics-supported#microsoftstreamanalyticsstreamingjobs) |
+[!INCLUDE [horz-monitor-ref-metrics-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-intro.md)]
 
-[!INCLUDE [metrics](./includes/metrics.md)]
-
-### Scenarios to monitor metrics
+### Supported metrics for Microsoft.StreamAnalytics/streamingjobs
+The following table lists the metrics available for the Microsoft.StreamAnalytics/streamingjobs resource type.
+[!INCLUDE [horz-monitor-ref-metrics-tableheader](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-tableheader.md)]
+[!INCLUDE [Microsoft.StreamAnalytics/streamingjobs](~/azure-reference-other-repo/azure-monitor-ref/supported-metrics/includes/microsoft-streamanalytics-streamingjobs-metrics-include.md)]
 
-[!INCLUDE [metrics-scenarios](./includes/metrics-scenarios.md)]
+### Metrics descriptions
 
-## Metric dimensions
-
-[!INCLUDE [metrics-dimensions](./includes/metrics-dimensions.md)]
+[!INCLUDE [metrics](./includes/metrics.md)]
 
-### Logical Name dimension
-[!INCLUDE [metrics-dimension-logical-name](./includes/metrics-dimension-logical-name.md)]
+[!INCLUDE [horz-monitor-ref-metrics-dimensions-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions-intro.md)]
 
-### Node Name dimension
-[!INCLUDE [metrics-dimension-node-name](./includes/metrics-dimension-node-name.md)]
+[!INCLUDE [horz-monitor-ref-metrics-dimensions](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions.md)]
 
-### Partition ID dimension
-[!INCLUDE [metrics-dimension-partition-id](./includes/metrics-dimension-partition-id.md)]
+- **Logical Name**: The input or output name for an Azure Stream Analytics job.
+- **Partition ID**: The ID of the input data partition from an input source.
+- **Node Name**: The identifier of a streaming node that's provisioned when a job runs.
 
-## Resource logs
+For detailed information, see [Dimensions for Azure Stream Analytics metrics](stream-analytics-job-metrics-dimensions.md).
 
-[!INCLUDE [resource-logs](./includes/resource-logs.md)]
+[!INCLUDE [horz-monitor-ref-resource-logs](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-resource-logs.md)]
 
-### Resource logs schema
+### Supported resource logs for Microsoft.StreamAnalytics/streamingjobs
+[!INCLUDE [Microsoft.StreamAnalytics/streamingjobs](~/azure-reference-other-repo/azure-monitor-ref/supported-logs/includes/microsoft-streamanalytics-streamingjobs-logs-include.md)]
 
-[!INCLUDE [resource-logs-schema](./includes/resource-logs-schema.md)]
+For the resource logs schema and properties for data errors and events, see [Resource logs schema](stream-analytics-job-diagnostic-logs.md#resource-logs-schema).
 
+[!INCLUDE [horz-monitor-ref-logs-tables](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-logs-tables.md)]
 
-## Activity log
-The following table lists the operations that Azure Stream Analytics may record in the Activity log. This set of operations is a subset of the possible entries you might find in the activity log.
+### Stream Analytics jobs
+microsoft.streamanalytics/streamingjobs
 
-| Namespace | Description |
-|:----------|:------------|
-| [Microsoft.StreamAnalytics](/azure/role-based-access-control/resource-provider-operations#microsoftstreamanalytics) | The operations that can be created in the Activity log for the Azure Data Share service. |
+- [AzureActivity](/azure/azure-monitor/reference/tables/AzureActivity#columns)
+- [AzureMetrics](/azure/azure-monitor/reference/tables/AzureMetrics#columns)
+- [AzureDiagnostics](/azure/azure-monitor/reference/tables/AzureDiagnostics#columns)
 
-See [all the possible resource provider operations in the activity log](/azure/role-based-access-control/resource-provider-operations).  For more information on the schema of Activity Log entries, see [Activity Log schema](/azure/azure-monitor/essentials/activity-log-schema). 
+[!INCLUDE [horz-monitor-ref-activity-log](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-activity-log.md)]
+- [Microsoft.StreamAnalytics resource provider operations](/azure/role-based-access-control/permissions/internet-of-things#microsoftstreamanalytics)
 
+## Related content
 
-## Next steps
-* [Introduction to Azure Stream Analytics](stream-analytics-introduction.md)
-* [Dimensions for Azure Stream Analytics metrics](./stream-analytics-job-metrics-dimensions.md)
-* [Understand and adjust streaming units](./stream-analytics-streaming-unit-consumption.md)
-* [Analyze Stream Analytics job performance by using metrics and dimensions](./stream-analytics-job-analysis-with-metric-dimensions.md)
-* [Monitor a Stream Analytics job with the Azure portal](./stream-analytics-monitoring.md)
-* [Get started with Azure Stream Analytics](stream-analytics-real-time-fraud-detection.md)
+- [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource)
+- [Monitor Azure Stream Analytics](monitor-azure-stream-analytics.md)
+- [Dimensions for Azure Stream Analytics metrics](stream-analytics-job-metrics-dimensions.md)
+- [Understand and adjust streaming units](stream-analytics-streaming-unit-consumption.md)