Skip to content

Commit e0df212

Browse files
Merge pull request #314302 from anjanb25/anjbanerjee-3-node-cluster
update the docs for SAP ASCS/ERS 3-node pacemaker cluster
2 parents 37aa43b + accf0f5 commit e0df212

9 files changed

Lines changed: 121 additions & 48 deletions

articles/sap/workloads/high-availability-guide-rhel-multi-sid.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -541,6 +541,12 @@ This article assumes that:
541541
sudo firewall-cmd --zone=public --add-port={62122,3222,3322,52213,52214,52216}/tcp
542542
```
543543

544+
> [!Note]
545+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
546+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
547+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
548+
549+
544550
### Proceed with the SAP installation
545551

546552
Complete your SAP installation by:

articles/sap/workloads/high-availability-guide-rhel-netapp-files.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -729,6 +729,12 @@ The following items are prefixed with either:
729729
sudo firewall-cmd --zone=public --add-port={62101,3201,3301,50113,50114,50116}/tcp
730730
```
731731

732+
> [!Note]
733+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
734+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
735+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
736+
737+
732738
## SAP NetWeaver application server preparation
733739

734740
Some databases require that the database instance installation runs on an application server. Prepare the application server VMs to be able to use them in these cases.

articles/sap/workloads/high-availability-guide-rhel-nfs-azure-files.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -648,6 +648,12 @@ The following items are prefixed with:
648648
sudo firewall-cmd --zone=public --add-port={62101,3201,3301,50113,50114,50116}/tcp
649649
```
650650
651+
> [!Note]
652+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
653+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
654+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
655+
656+
651657
## SAP NetWeaver application server preparation
652658
653659
Some databases require that the database instance installation runs on an application server. Prepare the application server VMs to be able to use them in these cases.

articles/sap/workloads/high-availability-guide-rhel.md

Lines changed: 30 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -524,7 +524,21 @@ The following items are prefixed with:
524524
# rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-0
525525
```
526526
527-
10. **[A]** Add firewall rules for ASCS and ERS on both nodes.
527+
10. **[1]** Run the following step to configure `priority-fencing-delay` (applicable only as of pacemaker-2.0.4-6.el8 or higher).
528+
529+
> [!NOTE]
530+
> If you have a two-node cluster, you have the option to configure the `priority-fencing-delay` cluster property. This property introduces additional delay in fencing a node that has higher total resource priority when a split-brain scenario occurs. For more information, see [Can Pacemaker fence the cluster node with the fewest running resources?](https://access.redhat.com/solutions/5110521)
531+
>
532+
> The property `priority-fencing-delay` is applicable for pacemaker-2.0.4-6.el8 version or higher. If you set up `priority-fencing-delay` on an existing cluster, make sure to clear the `pcmk_delay_max` setting in the fencing device.
533+
534+
```bash
535+
sudo pcs resource defaults update priority=1
536+
sudo pcs resource update rsc_sap_NW1_ASCS00 meta priority=10
537+
538+
sudo pcs property set priority-fencing-delay=15s
539+
```
540+
541+
11. **[A]** Add firewall rules for ASCS and ERS on both nodes.
528542
529543
```bash
530544
# Probe Port of ASCS
@@ -535,6 +549,12 @@ The following items are prefixed with:
535549
sudo firewall-cmd --zone=public --add-port={62102,3202,3302,50213,50214,50216}/tcp
536550
```
537551
552+
> [!Note]
553+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
554+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
555+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
556+
557+
538558
## SAP NetWeaver application server preparation
539559
540560
Some databases require that the database instance installation runs on an application server. Prepare the application server VMs to be able to use them in these cases.
@@ -725,7 +745,7 @@ Follow these steps to install an SAP application server.
725745
rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-0
726746
```
727747
728-
1. Simulate a node crash.
748+
2. Simulate a node crash.
729749
730750
Resource state before starting the test:
731751
@@ -798,7 +818,7 @@ Follow these steps to install an SAP application server.
798818
rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-1
799819
```
800820

801-
1. Block network communication.
821+
3. Block network communication.
802822

803823
Resource state before starting the test:
804824

@@ -827,14 +847,17 @@ Follow these steps to install an SAP application server.
827847

828848
By enabling the `priority-fencing-delay` property, the cluster introduces a delay in the fencing action, specifically on the node hosting ASCS resource, allowing the node to win the fence race.
829849

850+
> [!NOTE]
851+
> The `priority-fencing-delay` property applies only to two-node cluster configurations.
852+
830853
Run the following command to delete the firewall rule.
831854

832855
```bash
833856
# If the iptables rule set on the server gets reset after a reboot, the rules will be cleared out. In case they have not been reset, please proceed to remove the iptables rule using the following command.
834857
iptables -D INPUT -s 10.0.0.8 -j DROP; iptables -D OUTPUT -d 10.0.0.8 -j DROP
835858
```
836859

837-
1. Kill the message server process.
860+
4. Kill the message server process.
838861

839862
Resource state before starting the test:
840863

@@ -881,7 +904,7 @@ Follow these steps to install an SAP application server.
881904
rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-0
882905
```
883906

884-
1. Kill the enqueue server process.
907+
5. Kill the enqueue server process.
885908

886909
Resource state before starting the test:
887910

@@ -932,7 +955,7 @@ Follow these steps to install an SAP application server.
932955
rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-1
933956
```
934957

935-
1. Kill the enqueue replication server process.
958+
6. Kill the enqueue replication server process.
936959

937960
Resource state before starting the test:
938961

@@ -982,7 +1005,7 @@ Follow these steps to install an SAP application server.
9821005
rsc_sap_NW1_ERS02 (ocf::heartbeat:SAPInstance): Started nw1-cl-1
9831006
```
9841007
985-
1. Kill the enqueue `sapstartsrv` process.
1008+
7. Kill the enqueue `sapstartsrv` process.
9861009
9871010
Resource state before starting the test:
9881011

articles/sap/workloads/high-availability-guide-suse-multi-sid.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -531,6 +531,12 @@ The following picture shows how the resources would look like in the High Availa
531531

532532
[![A screenshot of the SUSE HAWK SAP NetWeaver cluster status screen.](./media/high-availability-guide-suse/ha-suse-multi-sid-hawk.png)](./media/high-availability-guide-suse/ha-suse-multi-sid-hawk-detail.png#lightbox)
533533

534+
> [!Note]
535+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
536+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
537+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
538+
539+
534540
### Proceed with the SAP installation
535541

536542
Complete your SAP installation by:

articles/sap/workloads/high-availability-guide-suse-netapp-files.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -678,7 +678,7 @@ The following items are prefixed with either **[A]** - applicable to all nodes,
678678
#### [ENSA2](#tab/ensa2)
679679
680680
> [!NOTE]
681-
> If you have a two-node cluster running ENSA2, you have the option to configure priority-fencing-delay cluster property. This property introduces additional delay in fencing a node that has higher total resource priority when a split-brain scenario occurs. For more information, see [SUSE Linux Enteprise Server high availability extension administration guide](https://documentation.suse.com/sle-ha/15-SP3/single-html/SLE-HA-administration/#pro-ha-storage-protect-fencing).
681+
> If you have a two-node cluster running ENSA2, you have the option to configure priority-fencing-delay cluster property. This property introduces additional delay in fencing a node that has higher total resource priority when a split-brain scenario occurs. For more information, see [SUSE Linux Enterprise Server high availability extension administration guide](https://documentation.suse.com/sle-ha/15-SP3/single-html/SLE-HA-administration/#pro-ha-storage-protect-fencing).
682682
>
683683
> The property priority-fencing-delay is only applicable for ENSA2 running on two-node cluster.
684684
@@ -754,6 +754,11 @@ sudo crm_mon -r
754754
# rsc_sap_QAS_ERS01 (ocf::heartbeat:SAPInstance): Started anftstsapcl2
755755
```
756756
757+
> [!Note]
758+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
759+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
760+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
761+
757762
## SAP NetWeaver application server preparation
758763
759764
Some databases require that the database instance installation is executed on an application server. Prepare the application server virtual machines to be able to use them in these cases.

articles/sap/workloads/high-availability-guide-suse-nfs-azure-files.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -591,7 +591,7 @@ The following items are prefixed with either **[A]** - applicable to all nodes,
591591
#### [ENSA2](#tab/ensa2)
592592

593593
> [!NOTE]
594-
> If virtual machines without public IPs are added to the backend pool of an internal Standard Azure load balancer, they won�t have internet access unless you set up extra routing to public endpoints. For more information, see [SUSE Linux Enteprise Server high availability extension administration guide](https://documentation.suse.com/sle-ha/15-SP3/single-html/SLE-HA-administration/#pro-ha-storage-protect-fencing).
594+
> If you have a two-node cluster running ENSA2, you have the option to configure priority-fencing-delay cluster property. This property introduces additional delay in fencing a node that has higher total resource priority when a split-brain scenario occurs. For more information, see [SUSE Linux Enterprise Server high availability extension administration guide](https://documentation.suse.com/sle-ha/15-SP3/single-html/SLE-HA-administration/#pro-ha-storage-protect-fencing).
595595
>
596596
> The property priority-fencing-delay is only applicable for ENSA2 running on two-node cluster.
597597

@@ -645,6 +645,12 @@ sudo crm_mon -r
645645
# rsc_sap_NW1_ERS01 (ocf::heartbeat:SAPInstance): Started sap-cl1
646646
```
647647

648+
> [!Note]
649+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
650+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
651+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
652+
653+
648654
## SAP NetWeaver application server preparation
649655

650656
Some databases require that the database instance installation is executed on an application server. Prepare the application server virtual machines to be able to use them in these cases.

articles/sap/workloads/high-availability-guide-suse-nfs-simple-mount.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -806,6 +806,12 @@ sudo crm_mon -r
806806
# rsc_sap_NW1_ERS01 (ocf::heartbeat:SAPInstance): Started sap-cl1
807807
```
808808

809+
> [!Note]
810+
> SAP ASCS/ERS cluster can be extended from 2-node to 3-node cluster with 3rd node as a spare node for failover of ASCS or ERS services.
811+
> - 3-node setup can only be used for SAP systems using SAP Enqueue Replication Server 2 (ENSA2).
812+
> - The cluster property `priority-fencing-delay` should not be used in a 3-node cluster.
813+
814+
809815
## Prepare the SAP application server
810816

811817
Some databases require you to execute the database installation on an application server. Prepare the application server VMs to be able to execute the database installation.

0 commit comments

Comments
 (0)