Skip to content

Commit a26cbd3

Browse files
Merge branch 'main' of https://github.com/MicrosoftDocs/azure-docs-pr into us540458-13
2 parents f0001df + 40441b9 commit a26cbd3

355 files changed

Lines changed: 3388 additions & 1471 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

articles/app-service/includes/quickstart-python/virtual-environment-setup.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,14 @@ ms.service: azure-app-service
77
---
88
#### [Windows](#tab/windows)
99

10-
```Console
10+
```cmd
1111
py -m venv .venv
1212
.venv\scripts\activate
1313
```
1414

1515
#### [macOS/Linux](#tab/mac-linux)
1616

17-
```Bash
17+
```bash
1818
python3 -m venv .venv
1919
source .venv/bin/activate
2020
```

articles/app-service/tutorial-python-postgresql-app-fastapi.md

Lines changed: 74 additions & 75 deletions
Large diffs are not rendered by default.

articles/app-testing/index.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -120,6 +120,8 @@ landingContent:
120120
linkLists:
121121
- linkListType: how-to-guide
122122
links:
123+
- text: Analyze tests using the results dashboard
124+
url: load-testing/how-to-understand-test-run-results-dashboard.md
123125
- text: Compare load test runs
124126
url: load-testing/how-to-compare-multiple-test-runs.md
125127
- text: Analyze results using AI insights

articles/app-testing/load-testing/how-to-compare-multiple-test-runs.md

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -12,13 +12,13 @@ ms.topic: how-to
1212

1313
# Compare load test runs in Azure Load Testing
1414

15-
In this article, you learn how you can compare test runs in Azure Load Testing. You can view trends across the last 10 test runs, or you can select and compare up to ten individual test runs. Optionally, you can mark a test run as a baseline to compare against.
15+
In this article, you learn how you can compare test runs in Azure Load Testing. You can view trends across the last few test runs, or you can select and compare up to 10 individual test runs. Optionally, you can mark a test run as a baseline to compare against.
1616

17-
To identify regressions over time, you can use the client-side metrics trends of the last 10 test runs, such as the response time, error rate, and more. In combination with [CI/CD integration](./quickstart-add-load-test-cicd.md), the trends data might help you identify which application build introduced a performance issue.
17+
To identify regressions over time, you can use the client-side metrics trends of the previous test runs, such as the response time, error rate, and more. In combination with [CI/CD integration](./quickstart-add-load-test-cicd.md), the trends data might help you identify which application build introduced a performance issue.
1818

1919
When you want to compare the client-side metrics trends against a specific reference test run, you can mark that test run as your baseline. For example, before you implement performance optimizations in your application, you might first create a baseline load test run, and then validate the effects of your optimizations against your baseline.
2020

21-
To compare both client-side and server-side metrics, you can select up to ten test runs, and compare them in the Azure Load Testing dashboard. The dashboard overlays the client-side and server-side metric graphs for each test run. By also comparing server-side application metrics in the dashboard, you can identify which application component was the root cause for a sudden performance degradation.
21+
To compare both client-side and server-side metrics, you can select up to 10 test runs, and compare them in the Azure Load Testing dashboard. The dashboard overlays the client-side and server-side metric graphs for each test run. By also comparing server-side application metrics in the dashboard, you can identify which application component was the root cause for a sudden performance degradation.
2222

2323
## Prerequisites
2424

@@ -28,9 +28,9 @@ To compare both client-side and server-side metrics, you can select up to ten te
2828

2929
## Compare multiple load test runs
3030

31-
To compare test runs in Azure Load Testing, you first have to select up to ten runs within a load test. You can only compare runs that belong to the same load test. After you select the test runs you want to compare, you can visually compare the client-side and server-side metrics for each test run in the load test dashboard.
31+
To compare test runs in Azure Load Testing, you first have to select up to 10 runs. These test runs can be from the same load test or from another load test. After you select the test runs you want to compare, you can visually compare the client-side and server-side metrics for each test run in the load test dashboard.
3232

33-
A test run needs to be in the *Done*, *Stopped*, or *Failed* state to compare it.
33+
A test run needs to be in the *Passed*, *Failed*, *Completed*, or *Stopped* state to compare it.
3434

3535
Use the following steps to select the test runs:
3636

@@ -45,7 +45,7 @@ Use the following steps to select the test runs:
4545

4646
1. Select two or more test runs, and then select **Compare** to compare test runs.
4747

48-
You can choose a maximum of ten test runs to compare.
48+
You can choose a maximum of 10 test runs to compare.
4949

5050
:::image type="content" source="media/how-to-compare-multiple-test-runs/compare-test-results-from-list.png" alt-text="Screenshot that shows a list of test runs and the 'Compare' button in the Azure portal." lightbox="media/how-to-compare-multiple-test-runs/compare-test-results-from-list.png":::
5151

@@ -58,9 +58,11 @@ Use the following steps to select the test runs:
5858
5959
:::image type="content" source="media/how-to-compare-multiple-test-runs/load-test-dashboard-compare-runs.png" alt-text="Screenshot of the load testing dashboard in the Azure portal, comparing two test runs." lightbox="media/how-to-compare-multiple-test-runs/load-test-dashboard-compare-runs.png":::
6060

61+
1. Optionally, you can change the test runs selected for comparison by selecting 'Update selection'. You can select test runs from the same load test or from a different one.
62+
6163
## View metrics trends across load test runs
6264

63-
To view metrics trends across test runs in Azure Load Testing, you need to have at least two test runs in the *Done*, or *Stopped* state. You can only view trends from runs that belong to the same load test.
65+
To view metrics trends across test runs in Azure Load Testing, you need to have at least two test runs in *Passed*, *Failed*, *Completed*, or *Stopped* state. You can only view trends from runs that belong to the same load test.
6466

6567
Use the following steps to view metrics trends across test runs:
6668

articles/app-testing/load-testing/how-to-diagnose-failing-load-test.md

Lines changed: 9 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -14,13 +14,7 @@ ms.topic: how-to
1414

1515
In this article, you learn how to diagnose and troubleshoot failing load tests in Azure Load Testing. Azure Load Testing provides several options to identify the root cause of a failing load test. For example, you can use the load test dashboard, or download the test results or test log files for an in-depth analysis. Alternately, configure server-side metrics to identify issues with application endpoint.
1616

17-
Azure Load Testing uses two indicators to determine the outcome of a load test:
18-
19-
- **Test status**: indicates whether the load test was able to start successfully and run the test script until the end. For example, the test status is *Failed* if there's an error in the JMeter or Locust test script, or if the [autostop listener](./how-to-define-test-criteria.md#auto-stop-configuration) interrupted the load test because too many requests failed.
20-
21-
- **Test result**: indicates the result of evaluating the [test fail criteria](./how-to-define-test-criteria.md). If at least one of the test fail criteria was met, the test result is set to *Failed*.
22-
23-
Depending on the indicator, you can use a different approach to identify the root cause of a test failure.
17+
Azure Load Testing uses the test run status to determine the outcome of a load test. Depending on the indicator, you can use a different approach to identify the root cause of a test failure. For more details on test run status, see [Analyze load tests using the results dashboard](./how-to-understand-test-run-results-dashboard.md#test-run-details)
2418

2519
## Prerequisites
2620

@@ -39,7 +33,7 @@ Use the following steps to get the outcome of a load test:
3933

4034
1. Select a test from the list to view all test runs for that test.
4135

42-
The list of test runs shows the **Test result** and **Test status** fields.
36+
The list of test runs shows the **Status** field.
4337

4438
:::image type="content" source="media/how-to-find-download-logs/load-testing-test-runs-list.png" alt-text="Screenshot that shows the list of test runs in the Azure portal, highlighting the test result and test status columns." lightbox="media/how-to-find-download-logs/load-testing-test-runs-list.png":::
4539

@@ -85,20 +79,21 @@ You can use a different approach for diagnosing a load test failure based whethe
8579

8680
### Load test failed to complete
8781

88-
When the load test fails to complete, the *test status* of the test run is set to *Failed*.
82+
When the load test fails to complete, the *status* of the test run is set to *Error* or *Stopped*.
8983

9084
A load test can fail to complete because of multiple reasons. Examples of why a load test doesn't finish:
9185

9286
- There are errors in the test script.
9387
- The test script uses JMeter features that Azure Load Testing doesn't support. Learn about the [supported JMeter features](./resource-jmeter-support.md).
9488
- The test script references a file or plugin that isn't available on the test engine instance.
95-
- The autostop functionality interrupted the load test because too many requests are failing and the error rate exceeds the threshold. Learn more about the [autostop functionality in Azure Load Testing](./how-to-define-test-criteria.md#auto-stop-configuration).
89+
- The auto-stop functionality interrupted the load test because too many requests are failing and the error rate exceeds the threshold. Learn more about the [autostop functionality in Azure Load Testing](./how-to-define-test-criteria.md#auto-stop-configuration).
9690

9791
Use the following steps to help diagnose a test not finishing:
9892

9993
1. Verify the error details on the load test dashboard.
10094
1. [Download and analyze the test logs](#download-apache-jmeter-or-locust-worker-logs-for-your-load-test) to identify issues in the JMeter test script.
10195
1. [Download the test results](./how-to-export-test-results.md) to identify issues with individual requests.
96+
1. Run the test in [debug mode](./how-to-run-tests-in-debug-mode.md) to get debug logs and request and response data for failed requests.
10297

10398
You can also view AI-based error insights for your test run after a test run completes. The insights generated contain the cause of error and more actionable recommendations. This feature is turned on by default and can be turned off in the error blade settings. Refer to [Microsoft Privacy Statement](https://go.microsoft.com/fwlink/?LinkId=521839).
10499

@@ -107,7 +102,7 @@ You can also view AI-based error insights for your test run after a test run com
107102
108103
### Load test completed
109104

110-
A load test might run the test script until the end (test status equals *Done*), but might not pass all the [test fail criteria](./how-to-define-test-criteria.md). If at least one of the test criteria didn't pass, the *test result* of the test run is set to *Failed*.
105+
A load test might run the test script until the end, but might not pass all the [test fail criteria](./how-to-define-test-criteria.md). If at least one of the test criteria didn't pass, the *status* of the test run is set to *Failed*.
111106

112107
Use the following steps to help diagnose a test failing to meet the test criteria:
113108

@@ -135,7 +130,9 @@ To download the worker logs for an Azure Load Testing test run, follow these ste
135130

136131
1. From the list of test runs, select a test run to view the load test dashboard.
137132

138-
1. On the dashboard, select **Download**, and then select **Logs**.
133+
1. On the dashboard, select **Download**, and then select **Logs**. To view the logs in Azure portal, select **View**. You can view the files in the storage container, select the required file and view the file. If the file format is not supported for viewing, you can select **Download** to download the specific file.
134+
135+
1. To download the logs files as a zipped folder, select **Download**.
139136

140137
The browser should now start downloading a zipped folder that contains the JMeter or Locust worker node log file for each [test engine instance](./concept-load-testing-concepts.md#test-engine).
141138

articles/app-testing/load-testing/how-to-export-test-results.md

Lines changed: 14 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ ms.topic: how-to
1212
---
1313
# Export test results from Azure Load Testing for use in third-party tools
1414

15-
In this article, you learn how to export your Azure Load Testing test results and reports. You can download the results by using the Azure portal, as an artifact in your CI/CD workflow, in JMeter by using a backend listener, in Locust by using event hooks or listener plugins, or by copying the results from an Azure storage account. You can use these results for reporting in third-party tools or for diagnosing test failures. Azure Load Testing generates the test results in comma-separated values (CSV) file format, and provides details of each application request for the load test.
15+
In this article, you learn how to export your Azure Load Testing test results and reports. You can view the results in the Azure portal, download the results using the Azure portal, as an artifact in your CI/CD workflow, in JMeter by using a backend listener, in Locust by using event hooks or listener plugins, or by copying the results from an Azure storage account. You can use these results for reporting in third-party tools or for diagnosing test failures. Azure Load Testing generates the test results in comma-separated values (CSV) file format, and provides details of each application request for the load test.
1616

1717
You can also use the test results to diagnose errors during a load test. The `responseCode` and `responseMessage` fields give you more information about failed requests. For more information about investigating errors, see [Diagnose failing load tests](./how-to-diagnose-failing-load-test.md).
1818

@@ -40,17 +40,17 @@ timeStamp,elapsed,label,responseCode,responseMessage,threadName,dataType,success
4040
1676040230680,101,Homepage,200,OK,172.18.33.7-Thread Group 1-1,text,true,,1591,133,5,5,https://www.example.com/,98,0,94
4141
```
4242

43-
## Access and download load test results and report
43+
## View and download load test results and report
4444

45-
After a load test run finishes, you can access and download the load test results and the HTML report through the Azure portal, or as an artifact in your CI/CD workflow.
45+
After a load test run finishes, you can view and download the load test results and the HTML report through the Azure portal, or as an artifact in your CI/CD workflow.
4646

4747
>[!IMPORTANT]
4848
>For load tests with more than 45 engine instances or a greater than 3-hour test run duration, the results file is not available for download. You can [configure a JMeter Backend Listener to export the results](#export-test-results-using-listeners) to a data store of your choice or [copy the results from a storage account container](#copy-test-artifacts-from-a-storage-account-container).
4949
>For tests with samplers greater than 30, the downloaded HTML report will only have graphs for data aggregated over all samplers. Graphs will not show sampler-wise data. Additionally, the downloaded report doesn't support graphs corresponding to server-side metrics.
5050
5151
# [Azure portal](#tab/portal)
5252

53-
To download the test results and the HTML report for a test run in the Azure portal:
53+
To view and download the test results and the HTML report for a test run in the Azure portal:
5454

5555
1. In the [Azure portal](https://portal.azure.com), go to your Azure Load Testing resource.
5656

@@ -65,14 +65,18 @@ To download the test results and the HTML report for a test run in the Azure por
6565

6666
* Select the ellipsis (**...**) next to the load test run you're working with, and then select **Download results file**.
6767

68-
:::image type="content" source="media/how-to-export-test-results/test-run-page-download.png" alt-text="Screenshot that shows how to download the results file for a load test run.":::
68+
:::image type="content" source="media/how-to-export-test-results/test-run-page-download.png" alt-text="Screenshot that shows how to download the results file for a load test run." lightbox="media/how-to-export-test-results/test-run-page-download.png":::
6969

7070
> [!NOTE]
71-
> A load test run needs to have a *Done*, *Stopped*, or *Failed* status for the results file to be available for download.
71+
> A load test run needs to have a *Passed*, *Failed*, *Completed*, or *Stopped* status for the results file to be available for download.
7272
73-
* Select **Download** on the **Test run details** pane. To download the results, select **Results**. To download the HTML report, select **Report**.
73+
* Select **Download** on the **Test run details** pane. To download the results, select **Results** and select **Download**. To download the HTML report, select **Report**.
7474

75-
:::image type="content" source="media/how-to-export-test-results/download-dashboard.png" alt-text="Screenshot that shows how to download the test results from the 'Test run details' pane.":::
75+
:::image type="content" source="media/how-to-export-test-results/download-dashboard.png" alt-text="Screenshot that shows how to download the test results from the 'Test run details' pane." lightbox="media/how-to-export-test-results/download-dashboard.png":::
76+
77+
* To view the results files in the storage container, select **Download** on the **Test run details** pane, select **Results** and select **View**. You can view the results files from all the test engines in the right context pane. Select the file that you want to download and select **Download**.
78+
79+
:::image type="content" source="media/how-to-export-test-results/view-results-file.png" alt-text="Screenshot that shows how to view the test results from the 'Test run details' pane." lightbox="media/how-to-export-test-results/view-results-file.png":::
7680

7781
1. You can use any zip tool to extract the folder and access the downloaded files.
7882

@@ -177,14 +181,14 @@ To copy the test results and log files for a test run from a storage account, in
177181
>[!TIP]
178182
> To limit the number of tests to display in the list, you can use the search box and the **Time range** filter.
179183

180-
1. On the **Test run details** pane, select **Copy artifacts**.
184+
1. On the **Test run details** pane, select **Download**, then select **Results** and select **View**. You can see the storage container view with the results files.
181185

182186
:::image type="content" source="media/how-to-export-test-results/test-run-page-copy-artifacts.png" alt-text="Screenshot that shows how to copy the test artifacts from the 'Test run details' pane.":::
183187

184188
> [!NOTE]
185189
> A load test run needs to be in the *Done*, *Stopped*, or *Failed* status for the results file to be available for download.
186190

187-
1. Copy the SAS URL of the storage account container.
191+
1. Select **Copy SAS URL** to copy the SAS URL of the storage account container.
188192

189193
You can use the SAS URL in the [Azure Storage Explorer](/azure/vs-azure-tools-storage-manage-with-storage-explorer?tabs=windows#shared-access-signature-sas-url) or [AzCopy](/azure/storage/common/storage-use-azcopy-blobs-copy#copy-a-container) to copy the results CSV files and the log files for the test run to your storage account.
190194

articles/app-testing/load-testing/how-to-high-scale-load.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,7 @@ For CI/CD workflows, you configure the number of engine instances in the [YAML t
229229

230230
1. Save the YAML configuration file, and commit the changes to source control.
231231

232+
---
232233

233234
## Monitor engine instance metrics
234235

0 commit comments

Comments
 (0)