Questions tagged [pacemaker]
Pacemaker achieves maximum availability for cluster services by detecting and recovering from node and service-level failures. It achieves this by utilizing the messaging and membership capabilities provided by your preferred cluster infrastructure (currently either OpenAIS or Heartbeat).
300
questions
0
votes
0
answers
9
views
How HA works when both Fencing agent VM and VM1(part of cluster) dies?
Say I have 3 servers-
Server 1 -> Fencing agent VM and VM1(part of pacemaker cluster)
Server 2 -> VM2 (part of pacemaker cluster)
Server 3-> VM3(part of Pacemaker cluster)
Say server 1 die ...
0
votes
0
answers
21
views
Expanding an Existing Oracle Linux Cluster
I'm seeking assistance with a situation involving an Oracle Linux 7.9 cluster that's currently running on a VMware virtual machine environment. We have two nodes in this cluster, labeled A and B.
Our ...
- 1,142
0
votes
1
answer
34
views
Virtual IP setup on two VMs using pacemaker
Do we need 3 VMs to set up pacemaker virtual IP to maintain quorum?
I currently have two VMs running Postgres bi-directional replication. I want to create one IP address for communication. How to ...
0
votes
0
answers
75
views
Azure Managed Lustre or another setup that allows Ubuntu VMs to perform parallel read/write operations to a shared block storage in the cloud?
I set up Azure Managed Lustre with 8TB and maximum throughput 4GB/s.
Following the official docs for an Ubuntu 20.04 VM with size Standard_L8as_v3, I manage to mount the file system.
Then I test my ...
1
vote
0
answers
53
views
Filesystem resource failed, Error=timeout during failover resource on pacemaker cluster
I try to setup NFS Active/passive + DRBD on Pacemaker cluster.
When i start cluster for the first time every things is ok but when i shutdown master node, resource move to another node but failed on ...
- 11
0
votes
0
answers
28
views
Scheduling PaceMaker resources based on Kubernetes pods
I would like to have a PaceMaker cloned resource be scheduled on all cluster nodes that have at least one instance of a specific Kubernetes pod running.
Background: I want to run a Kubernetes cluster ...
- 203
0
votes
1
answer
86
views
Pacemaker can no longer start Nginx after Debian upgrade
I have a Pacemaker cluster that controls several resources of type ocf:heartbeat:IPaddr2 and one of type ocf:heartbeat:nginx. Since an upgrade to Debian 12 it can no longer start Nginx. What happens ...
- 377
0
votes
0
answers
41
views
Pacemaker cloned resource stickiness
I have set up a small cluster of three nodes. I've created an IPaddr2 (or IPaddr3 from Percona) VIP and it came up ok. Initially, I have following distribution:
Full List of Resources:
* Clone Set: ...
- 1
0
votes
0
answers
139
views
pacemaker issues -- stonith
TL;DR: I need help setting up fencing on my pacemaker cluster.
I have a cluster of three machines running pacemaker. This is in my homelab, it's not a work setup.
Two are physical Dell servers. An ...
- 249
4
votes
1
answer
301
views
pacemaker agent nvmet-subsystem missing
I tried to follow the drbd Howto "Highly Available NVMe Over Fabrics (NVMe-oF) on RHEL 9", but run into the error
`Error: Unable to find agent 'nvmet-subsystem', try specifying its full name`...
- 41
5
votes
2
answers
540
views
Corosync/Pacemaker/DRBD Resilience Tuning
I have a DRBD cluster and one node was switched off for a couple of days. The single node ran fine without a hiccup. When i switch it on I got into a situation where all resources got stopped and one ...
- 173
4
votes
2
answers
394
views
Cannot write files into highly available NFS storage created with DRBD and Pacemake. (Permission denied error returned)
I am trying to set up a highly available NFS storage with DRBD and Pacemake (first time doing this), on 2 Fedora 38 VMs.
My main guidance on this endeavor were these 2 docs:
doc1
doc2
I've managed to ...
- 137
4
votes
1
answer
691
views
Pacemaker cluster does not cleanly failover DRBD-resource (but does so manually)
I had to upgrade a cluster from Ubuntu 16.04. It did work fine on 18.04 and 20.04 but now on 22.04 it does not failover the DRBD-device. Putting the resource into maintenance mode and performing a ...
0
votes
0
answers
118
views
Replacing pacemaker ip addresses with static IPs and then back again
Looking to upgrade corosync/pacemaker, a problem is that version 2 and 4 of corosync cannot communicate.
Having 3 nodes, on Ubuntu 20.04, seems like it will lead to a momentary split brain, will all ...
- 97
0
votes
0
answers
193
views
3-node Pacemaker setup shows 1 node 2 times, with the same name, one online and one offline
So I've got: machine001, machine002, machine003.
machine001 has 2 resources, machine002 has 1 resource. Normally they don't go on the same host, unless machine002 goes in standby.
Recently, I saw ...
- 97
0
votes
0
answers
18
views
File ownership changes when Cluster moves
I created a 2 node cluster..
# pcs resource config
Group: nodeapp
Resource: clusterip (class=ocf provider=heartbeat type=IPaddr)
Attributes: cidr_netmask=24 ip=10.6.151.103 nic=ens224:0
Operations: ...
- 1
1
vote
1
answer
834
views
How do I force pacemaker to keep restarting SystemD resource if it fails (instead of putting it into 'stopped' state)?
My goal is to implement 2 nodes HTTP load-balancer, using virtual IP (VIP). For this task I picked pacemaker (virtual IP switching) and Caddy for HTTP load-balancer. Load-balancer choice is not a ...
- 113
0
votes
0
answers
174
views
openstack pacemaker-schedulerd error
I have noticed this problem in the syslog and i'm not sure how to resolve this. I have openstack yoga with ubuntu 22.04 selfservice network option.
I have 1 controller node and 1 compute node
Dec 5 ...
- 351
1
vote
1
answer
411
views
Configure two node pacemaker cluster
I'm trying to configure a two node pacemaker cluster, such that services in 2 resource groups, should only be assigned on the same host if either of the nodes is down.
Can this be achieved with a 2 ...
- 11
0
votes
1
answer
475
views
Virtual IP in pacemaker cluster not pinging
I have two Linux rhel8 servers with pacemaker/corosync/pcsd installed. I've used the ocf:heartbeat:IPaddr2 resource to create a virtual IP for the cluster.
I have a similar setup on a few older ...
- 101
2
votes
2
answers
528
views
NFS Server - Corosync, DRBD & Pacemaker
I have 2 HA NFS server (Ubuntu with CoroSync, Pacemaker & DRBD).
Everything is working beautifully with one small issue.
If I kill an NFS it fails over seamlessly (NICE!)
As the killed node is ...
0
votes
1
answer
125
views
Configure and connect fence device through proxy server?
I'm setting up a cluster with Pacemaker and Corosync (from Clusterlabs).
It works fine but i need to configure the fencing.
Servers run on a VMWare ESXi infrastructure.
I have a frontend server (with ...
- 11
0
votes
1
answer
1k
views
DRBD does not promote resource on slave node after "pcs cluster stop --all"
I am trying to understand the recovering process of a promotable
resource after "pcs cluster stop --all" and shutdown of both nodes.
I have a two nodes + qdevice quorum with a DRBD resource.
...
- 21
1
vote
1
answer
137
views
Corosync allowing resources on two systems
We are using pacemaker/corosync for HA. This includes both virtual IP's and software. The other day we had a failure and corosync showed the IPAddress started on both nodes which IMHO should never ...
- 447
0
votes
1
answer
910
views
Pacemaker Virtual IP suddenly Failed
I am new in cluster.
We are running SAP Application in HA Cluster (have 2 nodes in cluster) using pacemaker. Node1 if it runs as a master always restart for a few times. After we check pacemaker logs, ...
1
vote
0
answers
620
views
PCS Cluster - Binding nfsserver resource to specific IP
I'm trying to deploy a HA NFS Cluster Architecture with PCS on Rocky Linux 8.5 . Current kernel and nfs related package versions, pcs configurations are shown with detail below.
I'm not able to ...
- 571
0
votes
1
answer
65
views
sendmail and pacemaker require different /etc/hosts
Trying to make run sendmail (required by fail2ban, or it takes forever to start-stop-restart it) and pacemaker on one machine.
Sendmail wants machine's hostname resolved as 127.0.0.1, pacemaker - as ...
- 1
1
vote
1
answer
968
views
Pacemaker error and warn log showing up in syslog rather than pacemaker.log
I created a ping check on pacemaker, like so:
pcs resource create ping ocf:pacemaker:ping dampen=5s multiplier=1000 host_list=127.0.0.1 clone
Used something other than 127.0.0.1 of course.
Here's the ...
- 293
0
votes
1
answer
222
views
Configuring STONITH on non-shared disk cluster
I have configured a 2 node (VMs) cluster with SUSE High Availability Extension.
The cluster doesn't use shared disk. So Stonith is not really required. But the cluster keeps on asking for Stonith.
So ...
- 33
3
votes
2
answers
296
views
Pacemaker - Logging the result of a ping check?
I read this page and the next: https://clusterlabs.org/pacemaker/doc/deprecated/en-US/Pacemaker/1.1/html/Pacemaker_Explained/_moving_resources_due_to_connectivity_changes.html
And it explains how to ...
- 293
3
votes
0
answers
594
views
Add a server to an already running DRBD9 configuration
I am on CentOS7 and I have an existing two-cluster HA node running pacemaker (1.1.23-1.el7_9.1) and DRBD (kmod-drbd90-9.0.22-3.el7_9). The backing partition for the DRBD drive is LUKS encrypted. We ...
- 131
0
votes
1
answer
272
views
Pacemaker Virtual IP is still pinging
I am having two node pacemaker cluster, with one virtual IP which is 192.168.3.100.
The virtual ip is the part of cluster resource, when I stop the cluster using pcs cluster stop --all.
I am still ...
- 1
0
votes
0
answers
473
views
Clustered vsftpd service stops working with no error log
We've got a pacemaker cluster of vsftpd server made of two nodes in a active/pasive scheme. We have experienced the following behaviour.
vsftpd.log stops recording activity while xferlog keeps ...
- 169
1
vote
1
answer
587
views
What is the Interaction of Timeouts and Intervals in Pacemaker Resource Monitor Operations
If I have a pacemaker resource like this:
Resource: FoobarServer (class=ocf provider=foo type=bar)
Operations: monitor interval=5m timeout=8m (FoobarServer-monitor-interval-5m)
...
- 13
0
votes
0
answers
632
views
Failed configuring active-active shared disk with drbd and pacemaker
I followed Clusters from Scratch instructions, chapters 8 and 9, to configure an active-active, shared disk cluster with drbd and pacemaker. The difference with that tutorial is that I am using OCFS2 ...
- 21
2
votes
0
answers
76
views
Is there a way to have pacemaker resource groups failover if all floating IP resources are unavailable?
I want to have multiple floating IPs in a resource group that will only failover if all IPs cannot work. Each floating IP is on a different subnet and can be used by the application I have. If a ...
- 21
0
votes
1
answer
7k
views
pcs creating cluster fails because of unknown hosts
I am following several tutorials now and all of them have such steps -- authenticate given hosts in pcs and then create cluster. Yet in my case the first step (authenticating) works while the second ...
- 361
3
votes
1
answer
376
views
Corosync-Pacemaker no split brain
I'm trying to set up a cluster of two nodes using CentOS 7, Corosync, Pacemaker and pcsd. I can migrate resources manually from one node to another, but if I turn off primary node (by unplugging the ...
- 51
0
votes
2
answers
2k
views
How to control start and stop of libvirtd and virtlockd in pacemaker cluster?
Using indirect locks of virtlockd (which is used by libvirtd) requires to use a cluster-wide shared filesystem like OCFS2.
In turn this means that virtlockd must be started after the shared filesystem ...
- 391
1
vote
0
answers
244
views
Preparing storage for DRBD
I am trying to set up high availability Linode server and using DBRD for data replication. I created primary partition using fdisk. But I get the error
WARNING: Re-reading the partition table failed ...
- 11
0
votes
0
answers
1k
views
CentOS 7 - GlusterFS & Pacemaker & Corosync
I try to install a little GlusterFS (for NFS) Cluster with CentOS High Availability.
I have really no idea why it failed. I started multiple times from scratch. My problem is, that I can't see any ...
- 115
2
votes
1
answer
608
views
pacemaker.log file is flooding with “Too many open files (24)”
My system is currently at Centos 8 and my /var/log/pacemaker/pacemaker.log file is flooding with GB of data and most of the error messages shows the below message.
These messages are more than 1000 in ...
- 21
1
vote
1
answer
2k
views
Cannot activate Logical Volume which was managed by Pacemaker
I have two CentOS 7 servers that clustered with Corosync and Pacemaker to work in Active/Passive way. The whole idea was to move the mount point in case of a problem emerges in the active node. My ...
0
votes
0
answers
247
views
How to use Apache resource by HTTPS in pacemaker?
I have a problem when i change apache url to HTTPS. Before the change every this working fine with http. Now my company need to use the Virtal ip by HTTPS. so that i didn't find any suitable tutorial ...
- 21
0
votes
0
answers
116
views
Geo cluster - quorum vs Booth
I configured a geo cluster using pacemaker and DRBD. The cluster has 3 different nodes, each node is in a different geographic location. The locations are pretty close to one another and the ...
- 101
1
vote
0
answers
150
views
Unable to write/mount disks with iscsi reservation and multipathd. Using Pacemaker and iscsi fence agent
I have two iscsi target servers in a pacemaker cluster connected to a Dell MD1200, I can get the scsi reservations recorded with the multipath.conf key configured in each server, but I can't write to ...
- 123
2
votes
1
answer
869
views
PCSD simple Master/Slave will not fail master over
I am trying to write a trivial pacemaker Master/Slave system. I created an agent, it's metadata follows:
elm_meta_data() {
cat <<EOF
<?xml version="1.0"?>
<!DOCTYPE ...
- 131
0
votes
2
answers
524
views
Pacemaker Corosync OCF Resource Lifecycle
I have been currently asked to setup Pacemaker Corosync and this is entirely new for me. I currently have a 2 node cluster. And what I want to do is to reassign the IP to the other node if active node ...
- 105
1
vote
1
answer
278
views
Pacemaker does not boot service after node switch
I am using two virtual Ubuntu servers (latest long-term) and both have equal configuration, and are running Squid services and pcs pacemaker corosync. I have two nodes Squid01 and Squid02 with one ...
- 11
1
vote
2
answers
775
views
SQL Server with Pacemaker on Ubuntu 18.04, 'Resource must be configured with notify=true'
I am trying to configure Pacemaker on 3 Ubuntu machines and I am following Microsoft's instructions
When done with all the cluster node are blocked and non of the resource is starting. The error I ...
- 9