You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: 'Azure ExpressRoute: Designing for high availability'
3
3
description: This page provides architectural recommendations for high availability while using Azure ExpressRoute.
4
-
services: expressroute
5
4
author: duongau
6
5
ms.service: azure-expressroute
7
6
ms.topic: concept-article
8
-
ms.date: 11/18/2024
7
+
ms.date: 03/16/2026
9
8
ms.author: duau
10
9
# Customer intent: As a network architect, I want to design a high availability Azure ExpressRoute setup, so that I can ensure robust and uninterrupted connectivity for my organization's critical applications and services.
11
10
---
@@ -21,25 +20,25 @@ Azure ExpressRoute is designed for high availability, providing carrier-grade pr
21
20
22
21
The following figure illustrates the recommended way to connect using an Azure ExpressRoute circuit to maximize availability.
23
22
24
-
[![1]][1]
23
+
:::image type="content" source="./media/designing-for-high-availability-with-expressroute/exr-reco.png" alt-text="Diagram of the recommended way to connect using Azure ExpressRoute for high availability.":::
25
24
26
25
For high availability, it's essential to maintain redundancy throughout the end-to-end network. This means maintaining redundancy within your on-premises network and not compromising redundancy within your service provider network. At a minimum, this involves avoiding single points of network failure. Redundant power and cooling for network devices further improve high availability.
27
26
28
27
### First mile physical layer design considerations
29
28
30
29
If you terminate both the primary and secondary connections of an Azure ExpressRoute circuit on the same Customer Premises Equipment (CPE), you compromise high availability within your on-premises network. Additionally, configuring both connections using the same port of a CPE forces the partner to compromise high availability on their network segment. This can occur by terminating the two connections under different subinterfaces or merging the two connections within the partner network, as illustrated below.
31
30
32
-
[![2]][2]
31
+
:::image type="content" source="./media/designing-for-high-availability-with-expressroute/suboptimal-lastmile-connectivity.png" alt-text="Diagram of suboptimal last mile connectivity for ExpressRoute circuits.":::
33
32
34
33
Terminating the primary and secondary connections of an Azure ExpressRoute circuit in different geographical locations can compromise network performance. If traffic is actively load-balanced across connections terminated in different locations, substantial differences in network latency between the two paths can result in suboptimal performance.
35
34
36
-
For geo-redundant design considerations, see [Designing for disaster recovery with Azure ExpressRoute][DR].
35
+
For geo-redundant design considerations, see [Designing for disaster recovery with Azure ExpressRoute](./designing-for-disaster-recovery-with-expressroute-privatepeering.md).
37
36
38
37
### Active-active connections
39
38
40
39
Microsoft network operates the primary and secondary connections of Azure ExpressRoute circuits in active-active mode. However, you can force the redundant connections to operate in active-passive mode through your route advertisements. Advertising more specific routes and BGP AS path prepending are common techniques to prefer one path over the other.
41
40
42
-
To improve high availability, it's recommended to operate both connections in active-active mode. This allows Microsoft network to load balance traffic across the connections on a per-flow basis.
41
+
To improve high availability, Microsoft recommends operating both connections in active-active mode. This allows Microsoft network to load balance traffic across the connections on a per-flow basis.
43
42
44
43
Running connections in active-passive mode risks both connections failing if the active path fails. Common causes for failure include lack of active management of the passive connection and passive connection advertising stale routes.
45
44
@@ -52,7 +51,7 @@ Alternatively, running connections in active-active mode results in only about h
52
51
53
52
Microsoft peering is designed for communication between public endpoints. Typically, on-premises private endpoints are Network Address Translated (NATed) with public IPs on the customer or partner network before communicating over Microsoft peering. Using both primary and secondary connections in an active-active setup affects how quickly you recover from a failure in one of the connections. Two different NAT options are illustrated below:
54
53
55
-
[![3]][3]
54
+
:::image type="content" source="./media/designing-for-high-availability-with-expressroute/nat-options.png" alt-text="Diagram of NAT options for Microsoft peering with ExpressRoute.":::
56
55
57
56
#### Option 1:
58
57
@@ -67,7 +66,7 @@ A common NAT pool is used before splitting traffic between the primary and secon
67
66
The NAT pool remains reachable even if the primary or secondary connection fails, allowing the network layer to reroute packets and recover faster.
68
67
69
68
> [!NOTE]
70
-
> * If using NAT option 1 (independent NAT pools for primary and secondary connections) and mapping a port of an IP address from one NAT pool to an on-premises server, the server will not be reachable via the Azure ExpressRoute circuit if the corresponding connection fails.
69
+
> * If using NAT option 1 (independent NAT pools for primary and secondary connections) and mapping a port of an IP address from one NAT pool to an on-premises server, the server won't be reachable via the Azure ExpressRoute circuit if the corresponding connection fails.
71
70
> * Terminating Azure ExpressRoute BGP connections on stateful devices can cause failover issues during planned or unplanned maintenance by Microsoft or your Azure ExpressRoute Provider. Test your setup to ensure proper failover, and when possible, terminate BGP sessions on stateless devices.
72
71
73
72
## Fine-tuning features for private peering
@@ -76,27 +75,14 @@ This section reviews optional features that help improve the high availability o
76
75
77
76
### Availability Zone aware Azure ExpressRoute virtual network gateways
78
77
79
-
An Availability Zone in an Azure region combines a fault domain and an update domain. To achieve the highest resiliency and availability, configure a zone-redundant Azure ExpressRoute virtual network gateway. For more information, see [About zone-redundant virtual network gateways in Azure Availability Zones][zoneredundant vgw]. To configure a zone-redundant virtual network gateway, see [Create a zone-redundant virtual network gateway in Azure Availability Zones][conf zoneredundant vgw].
78
+
An Availability Zone in an Azure region combines a fault domain and an update domain. To achieve the highest resiliency and availability, configure a zone-redundant Azure ExpressRoute virtual network gateway. For more information, see [About zone-redundant virtual network gateways in Azure Availability Zones](../vpn-gateway/about-zone-redundant-vnet-gateways.md). To configure a zone-redundant virtual network gateway, see [Create a zone-redundant virtual network gateway in Azure Availability Zones](../vpn-gateway/create-zone-redundant-vnet-gateway.md).
80
79
81
80
### Improving failure detection time
82
81
83
-
Azure ExpressRoute supports BFD over private peering, reducing failure detection time over the Layer 2 network between Microsoft Enterprise Edge (MSEEs) and their BGP neighbors on the on-premises side from about 3 minutes (default) to less than a second. Quick failure detection helps hasten recovery. For more information, see [Configure BFD over Azure ExpressRoute][BFD].
82
+
Azure ExpressRoute supports BFD over private peering, reducing failure detection time over the Layer 2 network between Microsoft Enterprise Edge (MSEEs) and their BGP neighbors on the on-premises side from about 3 minutes (default) to less than a second. Quick failure detection helps hasten recovery. For more information, see [Configure BFD over Azure ExpressRoute](./expressroute-bfd.md).
84
83
85
84
## Next steps
86
85
87
86
This article discussed designing for high availability of an Azure ExpressRoute circuit. An Azure ExpressRoute circuit peering point is pinned to a geographical location and can be affected by catastrophic failures impacting the entire location.
88
87
89
-
For design considerations to build geo-redundant network connectivity to the Microsoft backbone that can withstand catastrophic failures affecting an entire region, see [Designing for disaster recovery with Azure ExpressRoute private peering][DR].
90
-
91
-
<!--Image References-->
92
-
[1]: ./media/designing-for-high-availability-with-expressroute/exr-reco.png"Recommended way to connect using ExpressRoute"
93
-
[2]: ./media/designing-for-high-availability-with-expressroute/suboptimal-lastmile-connectivity.png"Suboptimal last mile connectivity"
For design considerations to build geo-redundant network connectivity to the Microsoft backbone that can withstand catastrophic failures affecting an entire region, see [Designing for disaster recovery with Azure ExpressRoute private peering](./designing-for-disaster-recovery-with-expressroute-privatepeering.md).
0 commit comments