Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
333
questions
2
votes
1
answer
100
views
Gluster: How to replace a brick in a dispersed volume?
I set up a 4+2 dispersed volume. It worked well so far.
gluster volume info
Volume Name: disperseVol
Type: Disperse
Volume ID: 35386b55-829c-4bac-bdba-609427269cf4
Status: Started
Snapshot Count: 0
...
0
votes
0
answers
32
views
Can glusterfs events APIs be used to warn of fs file changes?
My team is about to install glusterfd on our server infrastructure. I need to monitor when a file is added or deleted from the fs and call a url with the file name when this happens.
Can this be done ...
1
vote
0
answers
25
views
GlusterFS Critical Error: Negative fsal_fd_global_counter Freezes NFS Shares - Seeking Root Cause and Resolution
I'm encountering a critical issue in my GlusterFS setup that is causing NFS share freezing, leading to significant production downtime. The logs indicate a recurring error message:
21/11/2023 16:03:34 ...
0
votes
0
answers
78
views
How can I change a setting in the Glusterfs plugin for Docker?
I want to change a configuration in a docker plugin, I read this manual, and I use this command:
docker plugin set glusterfs:latest Config.PropagatedMount=/opt/docker/data/427680.427680/volumes/
but I'...
4
votes
0
answers
99
views
Data Replication Approaches for Hot Standby Architecture
I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
0
votes
0
answers
50
views
Failover and offline reads in GlusterFS?
I have a cluster, where all machines have the daemon running and the clients mounted. As far as I understand, only the machine where I run peer probe becomes the host.
If a client goes down:
the ...
21
votes
4
answers
37k
views
Are ZFS clustered filesystems possible?
Is it possible to create a ZFS cluster? Or would you need to go the seemingly ugly (to me at least) route of ZFS with UFS formatted pools governed by GlusterFS?
The idea is to see if it is possible ...
0
votes
1
answer
316
views
Postfix warning: not enough free space in mail queue
I have already checked the solutions at this post, but I can't find the reason.
This is my situation:
Running postfix inside a docker container (docker swarm).
Docker container has no quota.
/var/...
1
vote
0
answers
35
views
How do I restrict some directories to some clients in GlusterFS?
GlusterFS makes it possible with auth.ssl-allow option to allow or deny access to given volumes for a given client, identified by its SSL certificate, but the access is global: either the client has ...
0
votes
0
answers
64
views
How to mount glusterfs based san lun on another server and mount with ext4/xfs filesystem
I have one glusterfs based filesystem san lun with some data assigned to linux server and want to access that data on that server.
What are the possible ways to recover that data?
Tried to mount it ...
3
votes
1
answer
197
views
Howto: Block or File replication across 3+ nodes without a SAN
The setup
I admin the backend for a website that currently exists on a single node using Nginx (webserver), Neo4J (database) and Wildfly (app server). The website is getting enough traffic that we ...
2
votes
4
answers
783
views
Creating replicated gluster volume always gives Distributed-Replicate volume
Peace upon you,
I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume
i followed the following commands
Pool Peers
root@tiny1:~# gluster peer status
...
15
votes
5
answers
21k
views
Can I run mysqld on top of glusterfs?
I have been playing with glusterfs recently.
What I want to try is to run mysqld on top of the glusterfs in a similar way as it is possible to run MySQL on top of DRBD.
I am familiar with MySQL ...
7
votes
5
answers
22k
views
DRBD vs. GlusterFS for replication
I need to build a solution to host internal git repositories. It needs to supports hundreds of thousands (or more) repositories.
I plan on using multiple "dumb" servers with a shared storage, so ...
1
vote
1
answer
4k
views
Choosing between GlusterFS replica 2 or 3
I can't figure out the relation between the number of bricks and replica count.
I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
11
votes
2
answers
5k
views
Containerized PostgreSQL with data on a distributed file system
I am curious if somebody is actually running PostgreSQL in a container in production on some form of distributed file system - GlusterFS preferably, or anything.
I am currently running Mesos/Marathon....
0
votes
0
answers
46
views
Gluster 11, cannot make replicate volume
I'm trying to single node volume, convert to replicate volume by adding one more brick to gluster volume. I'm using command:
gluster volume add-brick replica 2
But every time I get Distributed-...
0
votes
0
answers
43
views
Erasure coding error detection ability
I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node.
I am ...
0
votes
0
answers
144
views
How to mount Gluster volume in a systemd-nspawn container?
I am trying to mount a Gluster volume within a systemd-nspawn container.
I found two methods to do it from the official Github repo, but I have questions about both methods' security.
The CAP_MKNOD + ...
0
votes
0
answers
54
views
Not automount volume after GlusterFS client booting up by autofs
I have configured GlusterFS between 3 rocky servers and mounting the gluster volume under /srv/gluster/vol01 directory. I had to install glusterfs-client in the 4th machine. My primary objective was ...
0
votes
0
answers
34
views
df command showing incorrect information
i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers
The machines size on Vcenter is 16.3To but when using df it shows ...
0
votes
1
answer
679
views
Filter groups that SSSD receives from AD server
We've got two Ubuntu 22.04 servers that use Kerberos and SSSD to authenticate users against an AD server. This works great.
The servers also have a GlusterFS volume that holds the user's home ...
0
votes
0
answers
128
views
Mysql /var/lib/mysql on Glusterfs
We are planing to deploy MySQL /var/lib/mysql (InnoDB) folder on Gluster server. Configuration is two Gluster servers + thin Arbiter. Gluster is in replica mode!
Does anybody have experience with ...
3
votes
1
answer
2k
views
glusterfs mounts get unmounted when 1 of the 2 bricks goes offline
I have an odd case where 1 of the 2 replicated glusterfs bricks will go offline and take all of the client mounts down with it. As I understand it, this should not be happening. It should fail over ...
2
votes
2
answers
941
views
Can I directly alter files located in a GlusterFS brick
On a storage node, GlusterFS bricks (the physical disks composing a GlusterFS volume) are typically mounted at a specific location. For example: /export/glusterfs/<volume>/brick0/brick.
However ...
1
vote
0
answers
54
views
Gluster replication / propagation to multiple remote servers
I'm new to the concept of Gluster, and I think I'm missing some key knowledge from Gluster documentation.
In my company, there are 10 application servers each with their own storage, and the current ...
1
vote
1
answer
2k
views
Cpu overuse replicating a Gluster Volume
I've this scenario:
srv01
srv02
srv03
there is a gluster volume "vol1" running on srv03, and all the servers can use for i/o. vol1 contains a lot of mixed side images, ranging from few kbs to 3-4Mb, ...
0
votes
1
answer
3k
views
Gluster and "failed to fetch volume file"
I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
2
votes
1
answer
2k
views
GlusterFS not running on correct port! (peer disconnected / brick not starting)
On CentOS 7 witch two bricks on srv1 and srv2
I've upgraded gluster from 313 to 6 by using yum. I then rebooted server 1, started and mounted the drive successfully.
This is my mount command:
/usr/...
1
vote
0
answers
104
views
sync apache2 config directory with glusterfs and restart service on directory change
I am trying to create a small 3 node ha cluster with apache2, php, mariadb with galera, glusterfs, haproxy and keepalived on debian 11. I want to sync the majority of config files (which are the same ...
5
votes
2
answers
2k
views
GlusterFS fails to mount on boot but mounts later in Ubuntu 12.04
Having two machines, profitmargin and revisionist, I created a volume in profitmargin:
root@profitmargin:~# gluster volume info
Volume Name: uploads
Type: Distribute
Status: Started
Number of Bricks:...
6
votes
1
answer
19k
views
GlusterFS Transport endpoint not connected from time to time
I'm using GlusterFS 3.7.9, currently on a single server with 4 bricks.
Each brick has 4TB and the volume is set up as distribute only.
The volume is mounted on a secondary server and I use it for ...
0
votes
1
answer
2k
views
"gluster volume status" errors out
Our monitoring script runs:
gluster volume status all
and parses the output analyzing the volumes and the bricks. Of late one of the Gluster-servers here started replying to the above command with ...
1
vote
2
answers
700
views
Why does Gluster volume mount with only half capacity
Problem: A Distributed-Replicate Gluster volume only has half capacity.
I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume.
Both Gluster servers ...
0
votes
0
answers
95
views
Independent distributed FS for Linux with ACL
I have two Linux servers in two locations connected by VPN (over WAN - 100/100 Mb/s). On each of these servers is Samba DC (the same domain) and Samba File Server.
Samba FS are configured to store ACL ...
3
votes
0
answers
2k
views
Gluster Performance
currently I try to setup a Gluster cluster and the performance is strange and I'm not sure, if I configured something wron. I'm using 4x Hetzner root server running Debian Buster with Intel i7, 128GB ...
2
votes
1
answer
1k
views
What are the "alternatives" to Heketi for Kubernetes?
I have built a working GlusterFS cluster, and now I want to make a Kubernetes StorageClass that uses it. I see a number of tutorials and documentation pointing to Heketi as the provisioner engine.
...
2
votes
1
answer
1k
views
Certain operations like 'ls' hang in 4-node gluster setup
I have a 4-node gluster setup with replication set to 2. The 'ls' command hangs on the Gluster mount that I have created. The other operations such as creating a file or reading a file work fine.
...
1
vote
2
answers
7k
views
the file-system of kvm virtual machine went to read-only after live migration
I setup my kvm virtualization environment with GlusterFS, the topology as follows:
KVM1 ---------- KVM2 --------------KVM3
|----------------------|-------------------------|
-----------------------|...
0
votes
0
answers
238
views
Debian gluster install doesn't work in Ubuntu 20.04
Following the instructions to add the gluster PPA to my Ubuntu 20.04 system, I get the following error when doing the apt update command:
Ign:5 https://download.gluster.org/pub/gluster/glusterfs/...
0
votes
1
answer
831
views
How can I split a zfs pool for storing VMs and Glusterfs separately on Proxmox?
I have a ProxmoxVE server which I created the following zpool on:
root@thor:\~# zpool list
NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
Asgard 5.45T 816K ...
1
vote
0
answers
1k
views
How to remove brick from failed Gluster peer?
I have a host that is damaged and is marked as Disconnected in the pool list. To remove the host and replace it I need to remove the brick.
Info of my bricks:
Volume Name: myvol
Type: Distributed-...
0
votes
1
answer
2k
views
How to force delete directory backed by Gluster that will not delete even when using -r option
Hi trying to delete a directory and no mater what I try I get: rm: cannot remove 'wont_delete/delete': Directory not empty
I'm running sudo rm -vr wont_delete/
The directory is on gluster fs.
Edit: ...
0
votes
3
answers
1k
views
Data resiliency in Ceph or Gluster
Say I am most concerned with keeping my data safe from physical hard drive failure and the computer it connects to directly.
RAID1 and RAID5 I understand. They provide protections against data loss ...
4
votes
2
answers
2k
views
glusterfs and dovecot problems
Ive got two servers with a shared glusterfs disk, both running dovecot and serving mail from this shared disk. Users read mail only from one of these servers but mail gets delivered to both. ...
2
votes
0
answers
3k
views
Glusterfs - Clients randomly disconnect until volume is restarted
Ubuntu 18.04
Glusterfs-7.0
I have created a volume for my file share and started it:
sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2
sudo gluster ...
9
votes
2
answers
11k
views
GlusterFS is failing to mount on boot
I'm running the official GlusterFS 3.5 packages on an Ubuntu 12.04 box that is acting as both, client and server, and everything seems to be working fine, except mounting the GlusterFS volumes at boot ...
8
votes
7
answers
21k
views
GlusterFS failing to mount at boot with Ubuntu 14.04
Previously I asked about mounting GlusterFS at boot in an Ubuntu 12.04 server and the answer was that this was buggy in 12.04 and worked in 14.04. Curious I gave it a try on a virtual machine running ...
2
votes
0
answers
421
views
GlusterFS volume stalls / blocks after quick access for PHP session files from PHP Docker container
2021-10-05 UPDATED QUESTION AND TEXT AFTER MORE ANALYSIS, STRIPPED DOWN TO MINIMAL CASE
Short description
A Nomad / Consul cluster is running, with Traefik (with minimal configuration) as a system ...
0
votes
2
answers
3k
views
GlusterFS SSL not working
I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me.
I have tried it the simple way:
openssl genrsa -out glusterfs.key ...