Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
325
questions
0
votes
0
answers
14
views
Gluster 11, cannot make replicate volume
I'm trying to single node volume, convert to replicate volume by adding one more brick to gluster volume. I'm using command:
gluster volume add-brick replica 2
But every time I get Distributed-...
- 1
0
votes
0
answers
27
views
Erasure coding error detection ability
I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node.
I am ...
- 23
0
votes
0
answers
44
views
How to mount Gluster volume in a systemd-nspawn container?
I am trying to mount a Gluster volume within a systemd-nspawn container.
I found two methods to do it from the official Github repo, but I have questions about both methods' security.
The CAP_MKNOD + ...
- 23
0
votes
0
answers
39
views
Not automount volume after GlusterFS client booting up by autofs
I have configured GlusterFS between 3 rocky servers and mounting the gluster volume under /srv/gluster/vol01 directory. I had to install glusterfs-client in the 4th machine. My primary objective was ...
0
votes
0
answers
24
views
df command showing incorrect information
i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers
The machines size on Vcenter is 16.3To but when using df it shows ...
0
votes
1
answer
61
views
Filter groups that SSSD receives from AD server
We've got two Ubuntu 22.04 servers that use Kerberos and SSSD to authenticate users against an AD server. This works great.
The servers also have a GlusterFS volume that holds the user's home ...
- 1
0
votes
0
answers
39
views
Mysql /var/lib/mysql on Glusterfs
We are planing to deploy MySQL /var/lib/mysql (InnoDB) folder on Gluster server. Configuration is two Gluster servers + thin Arbiter. Gluster is in replica mode!
Does anybody have experience with ...
- 1
2
votes
4
answers
195
views
Creating replicated gluster volume always gives Distributed-Replicate volume
Peace upon you,
I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume
i followed the following commands
Pool Peers
root@tiny1:~# gluster peer status
...
- 121
0
votes
0
answers
48
views
glusterfs choosing right layout of bricks/replicas for HA - able to sustain two node failure
So I already have glusterfs volume and it is working fine (I guess).
Now I am creating a new high-value prod setup and was starting to wonder - what is the "right" layout of nodes and bricks ...
- 1
0
votes
0
answers
95
views
Glusterfs io bandwidth or iops limitation
I am new to glusterfs and I am using glusterfs 9.6 with some iops sensitive job like etcd or some other process in one disk device.
The glusterfs is the least important program on my server. I am ...
- 1
1
vote
0
answers
24
views
Gluster replication / propagation to multiple remote servers
I'm new to the concept of Gluster, and I think I'm missing some key knowledge from Gluster documentation.
In my company, there are 10 application servers each with their own storage, and the current ...
- 23
1
vote
0
answers
63
views
sync apache2 config directory with glusterfs and restart service on directory change
I am trying to create a small 3 node ha cluster with apache2, php, mariadb with galera, glusterfs, haproxy and keepalived on debian 11. I want to sync the majority of config files (which are the same ...
- 11
0
votes
0
answers
62
views
Independent distributed FS for Linux with ACL
I have two Linux servers in two locations connected by VPN (over WAN - 100/100 Mb/s). On each of these servers is Samba DC (the same domain) and Samba File Server.
Samba FS are configured to store ACL ...
- 1
2
votes
1
answer
802
views
What are the "alternatives" to Heketi for Kubernetes?
I have built a working GlusterFS cluster, and now I want to make a Kubernetes StorageClass that uses it. I see a number of tutorials and documentation pointing to Heketi as the provisioner engine.
...
- 662
0
votes
0
answers
181
views
Debian gluster install doesn't work in Ubuntu 20.04
Following the instructions to add the gluster PPA to my Ubuntu 20.04 system, I get the following error when doing the apt update command:
Ign:5 https://download.gluster.org/pub/gluster/glusterfs/...
- 662
0
votes
1
answer
684
views
How can I split a zfs pool for storing VMs and Glusterfs separately on Proxmox?
I have a ProxmoxVE server which I created the following zpool on:
root@thor:\~# zpool list
NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
Asgard 5.45T 816K ...
- 101
1
vote
0
answers
823
views
How to remove brick from failed Gluster peer?
I have a host that is damaged and is marked as Disconnected in the pool list. To remove the host and replace it I need to remove the brick.
Info of my bricks:
Volume Name: myvol
Type: Distributed-...
- 273
0
votes
1
answer
973
views
How to force delete directory backed by Gluster that will not delete even when using -r option
Hi trying to delete a directory and no mater what I try I get: rm: cannot remove 'wont_delete/delete': Directory not empty
I'm running sudo rm -vr wont_delete/
The directory is on gluster fs.
Edit: ...
- 273
2
votes
0
answers
318
views
GlusterFS volume stalls / blocks after quick access for PHP session files from PHP Docker container
2021-10-05 UPDATED QUESTION AND TEXT AFTER MORE ANALYSIS, STRIPPED DOWN TO MINIMAL CASE
Short description
A Nomad / Consul cluster is running, with Traefik (with minimal configuration) as a system ...
- 51
2
votes
0
answers
1k
views
Glusterfs on Synology NAS?
I run a machine-learning cluster for my small business. The cluster consists of three Ubuntu servers. The 10TB /home directory, provided by Server 1, is shared across all servers and is almost full.
I'...
- 21
0
votes
1
answer
252
views
How to mount glusterfs at boot in centOS 7 lxc container?
Need to get a glusterfs volume mounted in a centos 7 lxc container.
found this and can do it manually ok...
But it seems that adding it in the fstab doesnt work because it gets executed before gluster ...
- 31
2
votes
0
answers
382
views
I'm looking for a way to configure distance clustering of postfix and dovecot
I currently have a postfix server and dovecot server sharing files from an NFS server in the UK and the same config in Switzerland. I tried to mailsync but that appeared to lose emails, so then I ...
- 620
1
vote
0
answers
69
views
GlusterFS not Sync geo
I activated GlusterFS synchronization with master/slave geo location.
At first everything working, however elw does not synchronize new files, only if I stop and delete-sync-time.
The number of ...
3
votes
1
answer
1k
views
Zero downtime with Kubernetes on top of GlusterFs on top of a ZFS raid - Is this the best solution?
TL;DR
A client requests me to make a robust system to run containerized microservices within their LAN.
Restriction: They give me 2 machines and 6 data-disks. No more hardware. I have to build "...
- 355
0
votes
0
answers
138
views
Glusterfs: rpc actor failed to complete successfully
I have glusterfs service running over CentOS 6, an I can see those errors filling up the logs continuously:
[2021-03-09 07:13:52.692995] E [rpcsvc.c:450:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc ...
- 127
2
votes
2
answers
645
views
Can I directly alter files located in a GlusterFS brick
On a storage node, GlusterFS bricks (the physical disks composing a GlusterFS volume) are typically mounted at a specific location. For example: /export/glusterfs/<volume>/brick0/brick.
However ...
- 1,604
1
vote
1
answer
686
views
Heketi - adding device with existing data
I have an OKD cluster with GlusterFS as a storage class and Heketi as a frontend. Everything works fine till destroy of the Heketi database. Now I can't make any changes to the storage, I can't add ...
- 604
1
vote
0
answers
71
views
Heavy network usage withg GlusterFS FUSE client
I have a simple GlusterFS 7.2 setup with 3 servers:
data1 and data2 contribute several bricks (4 each) to a distributed replicated GlusterFS volume.
host1 uses the GlusterFS FUSE client to mount the ...
- 111
3
votes
0
answers
1k
views
Gluster Performance
currently I try to setup a Gluster cluster and the performance is strange and I'm not sure, if I configured something wron. I'm using 4x Hetzner root server running Debian Buster with Intel i7, 128GB ...
- 478
0
votes
1
answer
159
views
GlusterFS - Define Failover Cluster
I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a ...
- 1
0
votes
1
answer
862
views
Numbers of bricks is not a multiple of replica count - glusterfs
I have 10 servers and want to use all as storage so tried to create volume with following command but its throwing error
gluster volume create gv0 replica 3 server1:/data/brick1/gv0 server2:/data/...
- 135
0
votes
0
answers
911
views
CentOS 7 - GlusterFS & Pacemaker & Corosync
I try to install a little GlusterFS (for NFS) Cluster with CentOS High Availability.
I have really no idea why it failed. I started multiple times from scratch. My problem is, that I can't see any ...
- 115
0
votes
3
answers
1k
views
Data resiliency in Ceph or Gluster
Say I am most concerned with keeping my data safe from physical hard drive failure and the computer it connects to directly.
RAID1 and RAID5 I understand. They provide protections against data loss ...
- 41
1
vote
0
answers
214
views
Single Gluster peer rebalancing inconsistently
I have a pool of 5 Gluster servers with individual bricks for a volume operating in Dispersed mode, to which I have added an extra 5 peers with individual bricks in another datacenter, making this ...
- 33
1
vote
0
answers
54
views
Optimal volume setup in Glusterfs
I have a number of servers and am wondering what the most optimal volume setup would be. Initially, there'll be 5 servers but over 20 later on. Each server has 16 x 3TB drives.
Essentially, I want to ...
- 85
3
votes
3
answers
1k
views
Glusterfs on web server
I want to build a HA Web service and I was planning to use Glusterfs on three nodes (with replica 3).
My plan was to install web server directly on Gluster nodes.
Is this a viable solution or is there ...
- 33
2
votes
1
answer
1k
views
How should I recover from Ovirt and GlusterFS partial failure?
I am managing a 3 node Ovirt 4.3.7 cluster with a hosted engine appliance; the nodes are also glusterfs nodes. The systems are:
ovirt1 (node at 192.168.40.193)
ovirt2 (node at 192.168.40.194)
ovirt3 (...
- 131
0
votes
2
answers
806
views
CTDB Samba script failing to start
Here is the output from a tail -f /var/log/ctdb/log.ctdb
2020/01/27 18:52:52.317670 ctdbd[3330]: Running the "startup" event.
2020/01/27 18:53:22.323208 ctdbd[3330]: startup event failed
2020/01/27 ...
- 101
1
vote
1
answer
660
views
GlusterFS Volume Creation Suggestion
I have to deploy multiple Openshift Clusters from 3 nodes to 10 nodes. For 3 nodes i am creating volumes as replicated.
But for 4 and above it doesn't look nice to create replicated volume, so each ...
- 135
0
votes
1
answer
556
views
HAProxy + Dovecot + Gluster
I'm looking to setup 2 dovecot servers behind HAProxy using gluster for a high-availability solution. From the reading I've been doing, it seems that dovecot highly suggests the use of the dovecot ...
- 239
2
votes
0
answers
2k
views
Glusterfs - Clients randomly disconnect until volume is restarted
Ubuntu 18.04
Glusterfs-7.0
I have created a volume for my file share and started it:
sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2
sudo gluster ...
- 35
1
vote
2
answers
604
views
K3S arm64 distributed files systems
I deployed a K3S Cluster on arm64 and I need to have a DFS directly on-premise, It will be better to have it running on the kubernetes stack.
Regarding DFS choices there are some options, but...:
...
- 113
0
votes
0
answers
116
views
Should I use GlusterFS for mail server?
I'm planing to use GlusterFS for my mail server. But I read that GlusterFS have problems with small file ( and mail are small files). What's the problems with GlusterFS when come to working with small ...
- 191
0
votes
1
answer
47
views
How to test and evaluate performent of a storage system? Compare between NFS and GlusterFS?
I have an exercise at school about the title question,I have google search for couple of hours but I'm not found anythings useful.
I only know that when come to HA, GlusterFS remove the single point ...
- 191
1
vote
2
answers
1k
views
GlusterFS or Ceph RBD for storing Virtual Machine image
I am using glusterfs 5.3 for storing images of virtual machines in Cloudstack/KVM environment, majority of VMs are DB Servers (Sql Server & MariaDB). But I am facing performance issue on VMs ...
- 11
3
votes
0
answers
2k
views
Previously mountable GlusterFS volume now fails to mount with several errors
I've previously set up a couple of GlusterFS volumes (called cyclorana0 and cyclorana1) across two nodes (with IPs 10.0.2.4 (hostname alboguttata) and 10.0.2.5 (hostname verrucosa)) on my LAN. The ...
- 845
1
vote
1
answer
3k
views
Choosing between GlusterFS replica 2 or 3
I can't figure out the relation between the number of bricks and replica count.
I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
- 137
0
votes
0
answers
106
views
What could cause a mount to suddenly unmount?
I have been running glusterfs 3.4 in AWS for a couple months now, over the past month the glusterfs mount has disappeared from the gluster client server.
Stats from the client server seem normal,
...
- 128
2
votes
1
answer
2k
views
GlusterFS not running on correct port! (peer disconnected / brick not starting)
On CentOS 7 witch two bricks on srv1 and srv2
I've upgraded gluster from 313 to 6 by using yum. I then rebooted server 1, started and mounted the drive successfully.
This is my mount command:
/usr/...
- 21
0
votes
1
answer
82
views
K8S: securing GlusterFS
I have a question on how to divide access to the same gluster for different K8S namespaces. Let's say, I have 3 different volumes (vol-a, vol-b, vol-c) in a gluster and I'd like to permit access to ...
- 577