Skip to content

Commit 4d1eaf4

Browse files
committed
update
1 parent 2beb05a commit 4d1eaf4

1 file changed

Lines changed: 18 additions & 18 deletions

File tree

support/azure/azure-monitor/app-insights/telemetry/troubleshoot-high-data-ingestion.md

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
title: Troubleshoot high data ingestion in Application Insights
33
description: Provides a step-by-step guide to troubleshoot high data ingestion scenarios and provides methods to reduce costs.
4-
ms.date: 03/27/2025
4+
ms.date: 03/28/2025
55
ms.service: azure-monitor
66
ms.reviewer: jeanbisutti, toddfous, aaronmax, v-weizhu
77
ms.custom: sap:Application Insights
@@ -14,7 +14,7 @@ An increase in billing charges for Application Insights or Log Analytics often o
1414

1515
### Step 1: Identify resources presenting high data ingestion
1616

17-
In the Azure portal, navigate to cost analysis for your scope. For example: **Cost Management + Billing** > **Cost Management** > **Cost analysis**. This blade offers cost analysis views to chart costs per resource, as follows:
17+
In the Azure portal, navigate to your subscription and select **Cost Management** > **Cost analysis**. This blade offers cost analysis views to chart costs per resource, as follows:
1818

1919
:::image type="content" source="media/troubleshoot-high-data-ingestion/cost-analysis.png" alt-text="A screenshot thst shows the 'cost analysis' blade." border="false":::
2020

@@ -28,10 +28,10 @@ Once you've identified an Application Insights resource or a Log Analytics works
2828
Use the following query to compare record counts across tables:
2929

3030
```Kusto
31-
search \*
31+
search *
3232
| where timestamp > ago(7d)
3333
| summarize count() by $table
34-
| sort by count\_ desc
34+
| sort by count_ desc
3535
```
3636
3737
This query can help identify the *noisiest* tables. From there, you can refine your queries to narrow down the investigation.
@@ -47,16 +47,16 @@ Once you've identified an Application Insights resource or a Log Analytics works
4747
| extend BillingTelemetryType = tostring(dimensions["BillingTelemetryType"])
4848
| extend BillingTelemetrySizeInBytes = todouble(measurements["BillingTelemetrySize"])
4949
| summarize TotalBillingTelemetrySize = sum(BillingTelemetrySizeInBytes) by BillingTelemetryType
50-
| extend BillingTelemetrySizeGB = format\_bytes(TotalBillingTelemetrySize, 1 ,"GB")
50+
| extend BillingTelemetrySizeGB = format_bytes(TotalBillingTelemetrySize, 1 ,"GB")
5151
| sort by BillingTelemetrySizeInBytes desc
5252
| project-away BillingTelemetrySizeInBytes
5353
```
5454
5555
Similar to the record count queries, these queries above can assist in identifying the most active tables, allowing you to pinpoint specific tables for further investigation.
5656
57-
- Using Log Analytics workbooks
57+
- Using Log Analytics workspace Workbooks
5858
59-
In the Azure portal, navigate to your Log Analytics workspace, select **Workbooks**, and select **Usage** under **Log Analytics Workspace Insights**.
59+
In the Azure portal, navigate to your Log Analytics workspace, select **Monitoring** > **Workbooks**, and then select **Usage** under **Log Analytics Workspace Insights**.
6060
6161
:::image type="content" source="media/troubleshoot-high-data-ingestion/log-analytics-usage-workbook.png" alt-text="A screenshot thst shows the Log Analytics workbook pane." lightbox="media/troubleshoot-high-data-ingestion/log-analytics-usage-workbook.png" border="false":::
6262
@@ -136,7 +136,7 @@ exceptions
136136
| where timestamp > ago(7d)
137137
| where cloud_RoleName == 'Specify a role name'
138138
| summarize count() by type
139-
| sort by count_ desc<o:p></o:p>
139+
| sort by count_ desc
140140
```
141141

142142
```Kusto
@@ -155,8 +155,8 @@ In the following queries, the [bin()](/kusto/query/bin-function) Kusto Query Lan
155155

156156
```Kusto
157157
dependencies
158-
| where timestamp &gt; ago(30d)
159-
| summarize count() by bin(timestamp, 1d), operation\_Name
158+
| where timestamp > ago(30d)
159+
| summarize count() by bin(timestamp, 1d), operation_Name
160160
| sort by timestamp desc
161161
```
162162

@@ -177,11 +177,11 @@ dependencies
177177
1. Query all tables within a Log Analytics workspace.
178178

179179
```Kusto
180-
search \*
181-
| where TimeGenerated &gt; ago(7d)
182-
| where \_IsBillable == true
183-
| summarize TotalBilledSize = sum(\_BilledSize) by $table
184-
| extend IngestedVolumeGB = format\_bytes(TotalBilledSize, 1, "GB")
180+
search *
181+
| where TimeGenerated > ago(7d)
182+
| where _IsBillable == true
183+
| summarize TotalBilledSize = sum(_BilledSize) by $table
184+
| extend IngestedVolumeGB = format_bytes(TotalBilledSize, 1, "GB")
185185
| sort by TotalBilledSize desc
186186
| project-away TotalBilledSize
187187
```
@@ -229,7 +229,7 @@ To determine the factors contributing to the costs, follow these steps:
229229
1. Query the telemetry across all tables and obtain a record count per table and SDK version:
230230
231231
```Kusto
232-
search \*
232+
search *
233233
| where TimeGenerated > ago(7d)
234234
| summarize count() by $table, SDKVersion
235235
| sort by count_ desc
@@ -300,7 +300,7 @@ The default recommended solution is using [sampling overrides](/azure/azure-moni
300300

301301
There are some supplemental methods to sampling overrides:
302302

303-
- Reduce cost from the `traces` table (**logs** and **Trace** on the Application Insights page):
303+
- Reduce cost from the `traces` table:
304304

305305
- [Reduce the telemetry log level](/azure/azure-monitor/app/java-standalone-config#autocollected-logging)
306306
- [Remove application (not frameworks/libs) logs with MDC attribute and sampling override](/azure/azure-monitor/app/java-standalone-sampling-overrides#suppress-collecting-telemetry-for-log)
@@ -318,7 +318,7 @@ There are some supplemental methods to sampling overrides:
318318

319319
- Reduce cost from the `dependencies` table:
320320

321-
- [Suppress collecting telemetry for the Java method producing the dependency telemetry](/azure/azure-monitor/app/java-standalone-sampling-overrides#suppress-collecting-telemetry-for-a-java-method)
321+
- [Suppress collecting telemetry for the Java method producing the dependency telemetry](/azure/azure-monitor/app/java-standalone-sampling-overrides#suppress-collecting-telemetry-for-a-java-method).
322322
- [Disable the instrumentation](/azure/azure-monitor/app/java-standalone-config#suppress-specific-autocollected-telemetry) producing the dependency telemetry data.
323323

324324
If the dependency is a database call, you then won't see the database on the application map. If you remove the dependency instrumentation of an HTTP call or a message (for example a Kafka message), all the downstream telemetry data are dropped.

0 commit comments

Comments
 (0)