|
| 1 | +--- |
| 2 | +title: Understanding and Mitigating High Data Consumption in Log Analytics |
| 3 | +description: Provides step-by-step instructions on how to resolve high data usage in Log Analytics. |
| 4 | +ms.date: 07/16/2025 |
| 5 | +ms.reviewer: v-liuamson; v-gsitser |
| 6 | +ms.service: azure-monitor |
| 7 | +ms.custom: Configure and Manage Log analytics tables |
| 8 | +--- |
| 9 | + |
| 10 | +# Understanding and Mitigating High Data Consumption in Log Analytics |
| 11 | + |
| 12 | +## Introduction |
| 13 | + |
| 14 | +This article addresses the issue of high data consumption in Log Analytics workspaces, specifically focusing on tables like `AzureDiagnostics`. It provides insights into understanding the costs associated with data usage and offers steps to optimize and reduce these costs. |
| 15 | + |
| 16 | +## Step-by-Step Instructions to Resolve High Data Usage |
| 17 | + |
| 18 | +### 1. Identify High Data Tables |
| 19 | + |
| 20 | +- Use the `AzureDiagnostics` table to determine which Reference are sending large amounts of data. |
| 21 | +- Run the following query in your Log Analytics workspace: |
| 22 | + |
| 23 | + ```plaintext |
| 24 | + AzureDiagnostics | distinct _ResourceId |
| 25 | + ``` |
| 26 | +
|
| 27 | +- This will help you identify the Reference contributing to high data usage. |
| 28 | +
|
| 29 | +### 2. Review Diagnostic Settings |
| 30 | +
|
| 31 | +- Navigate to the diagnostic settings of the identified Reference. |
| 32 | +- Remove unnecessary diagnostic settings if the data is not needed. This will stop the data from being sent to the AzureDiagnostics table. |
| 33 | +
|
| 34 | +### 3. Understand Cost Implications |
| 35 | +
|
| 36 | +Review the following Reference to understand the costs associated with your Log Analytics workspace: |
| 37 | +
|
| 38 | +- [Understand Log Analytics Workspace Billing](https://learn.microsoft.com/azure/azure-monitor/log-analytics/billing/understand-log-analytics-workspace-bill) |
| 39 | +- [Best Practices for Cost Management](https://learn.microsoft.com/azure/azure-monitor/fundamentals/best-practices-cost) |
| 40 | +- [Cost Management for Logs](https://learn.microsoft.com/azure/azure-monitor/logs/cost-logs) |
| 41 | +
|
| 42 | +### 4. Implement Cost Optimization Strategies |
| 43 | +
|
| 44 | +- Follow the best practices outlined in the Reference to optimize data usage and reduce costs. |
| 45 | +
|
| 46 | +## Common Issues and Solutions |
| 47 | +
|
| 48 | +- **Data Retention**: Ensure that data retention settings are configured appropriately to avoid unnecessary storage costs. |
| 49 | +- **Data Filtering**: Implement data filtering to only collect necessary data, reducing the volume of data ingested. |
| 50 | +
|
| 51 | +## Reference |
| 52 | +
|
| 53 | +- [Understand Log Analytics Workspace Billing](https://learn.microsoft.com/azure/azure-monitor/log-analytics/billing/understand-log-analytics-workspace-bill) |
| 54 | +- [Best Practices for Cost Management](https://learn.microsoft.com/azure/azure-monitor/fundamentals/best-practices-cost) |
| 55 | +- [Cost Management for Logs](https://learn.microsoft.com/azure/azure-monitor/logs/cost-logs) |
| 56 | +
|
| 57 | +If the issue persists after following the solution steps, please open a support case for further assistance. |
0 commit comments