Questions tagged [glusterfs]

GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.

Filter by
Sorted by
Tagged with
2 votes
1 answer
100 views

Gluster: How to replace a brick in a dispersed volume?

I set up a 4+2 dispersed volume. It worked well so far. gluster volume info Volume Name: disperseVol Type: Disperse Volume ID: 35386b55-829c-4bac-bdba-609427269cf4 Status: Started Snapshot Count: 0 ...
0 votes
0 answers
32 views

Can glusterfs events APIs be used to warn of fs file changes?

My team is about to install glusterfd on our server infrastructure. I need to monitor when a file is added or deleted from the fs and call a url with the file name when this happens. Can this be done ...
1 vote
0 answers
25 views

GlusterFS Critical Error: Negative fsal_fd_global_counter Freezes NFS Shares - Seeking Root Cause and Resolution

I'm encountering a critical issue in my GlusterFS setup that is causing NFS share freezing, leading to significant production downtime. The logs indicate a recurring error message: 21/11/2023 16:03:34 ...
0 votes
0 answers
78 views

How can I change a setting in the Glusterfs plugin for Docker?

I want to change a configuration in a docker plugin, I read this manual, and I use this command: docker plugin set glusterfs:latest Config.PropagatedMount=/opt/docker/data/427680.427680/volumes/ but I'...
4 votes
0 answers
99 views

Data Replication Approaches for Hot Standby Architecture

I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
0 votes
0 answers
50 views

Failover and offline reads in GlusterFS?

I have a cluster, where all machines have the daemon running and the clients mounted. As far as I understand, only the machine where I run peer probe becomes the host. If a client goes down: the ...
21 votes
4 answers
37k views

Are ZFS clustered filesystems possible?

Is it possible to create a ZFS cluster? Or would you need to go the seemingly ugly (to me at least) route of ZFS with UFS formatted pools governed by GlusterFS? The idea is to see if it is possible ...
0 votes
1 answer
316 views

Postfix warning: not enough free space in mail queue

I have already checked the solutions at this post, but I can't find the reason. This is my situation: Running postfix inside a docker container (docker swarm). Docker container has no quota. /var/...
1 vote
0 answers
35 views

How do I restrict some directories to some clients in GlusterFS?

GlusterFS makes it possible with auth.ssl-allow option to allow or deny access to given volumes for a given client, identified by its SSL certificate, but the access is global: either the client has ...
0 votes
0 answers
64 views

How to mount glusterfs based san lun on another server and mount with ext4/xfs filesystem

I have one glusterfs based filesystem san lun with some data assigned to linux server and want to access that data on that server. What are the possible ways to recover that data? Tried to mount it ...
3 votes
1 answer
197 views

Howto: Block or File replication across 3+ nodes without a SAN

The setup I admin the backend for a website that currently exists on a single node using Nginx (webserver), Neo4J (database) and Wildfly (app server). The website is getting enough traffic that we ...
2 votes
4 answers
783 views

Creating replicated gluster volume always gives Distributed-Replicate volume

Peace upon you, I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume i followed the following commands Pool Peers root@tiny1:~# gluster peer status ...
15 votes
5 answers
21k views

Can I run mysqld on top of glusterfs?

I have been playing with glusterfs recently. What I want to try is to run mysqld on top of the glusterfs in a similar way as it is possible to run MySQL on top of DRBD. I am familiar with MySQL ...
7 votes
5 answers
22k views

DRBD vs. GlusterFS for replication

I need to build a solution to host internal git repositories. It needs to supports hundreds of thousands (or more) repositories. I plan on using multiple "dumb" servers with a shared storage, so ...
1 vote
1 answer
4k views

Choosing between GlusterFS replica 2 or 3

I can't figure out the relation between the number of bricks and replica count. I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
11 votes
2 answers
5k views

Containerized PostgreSQL with data on a distributed file system

I am curious if somebody is actually running PostgreSQL in a container in production on some form of distributed file system - GlusterFS preferably, or anything. I am currently running Mesos/Marathon....
0 votes
0 answers
46 views

Gluster 11, cannot make replicate volume

I'm trying to single node volume, convert to replicate volume by adding one more brick to gluster volume. I'm using command: gluster volume add-brick replica 2 But every time I get Distributed-...
0 votes
0 answers
43 views

Erasure coding error detection ability

I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node. I am ...
0 votes
0 answers
144 views

How to mount Gluster volume in a systemd-nspawn container?

I am trying to mount a Gluster volume within a systemd-nspawn container. I found two methods to do it from the official Github repo, but I have questions about both methods' security. The CAP_MKNOD + ...
0 votes
0 answers
54 views

Not automount volume after GlusterFS client booting up by autofs

I have configured GlusterFS between 3 rocky servers and mounting the gluster volume under /srv/gluster/vol01 directory. I had to install glusterfs-client in the 4th machine. My primary objective was ...
0 votes
0 answers
34 views

df command showing incorrect information

i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers The machines size on Vcenter is 16.3To but when using df it shows ...
0 votes
1 answer
679 views

Filter groups that SSSD receives from AD server

We've got two Ubuntu 22.04 servers that use Kerberos and SSSD to authenticate users against an AD server. This works great. The servers also have a GlusterFS volume that holds the user's home ...
0 votes
0 answers
128 views

Mysql /var/lib/mysql on Glusterfs

We are planing to deploy MySQL /var/lib/mysql (InnoDB) folder on Gluster server. Configuration is two Gluster servers + thin Arbiter. Gluster is in replica mode! Does anybody have experience with ...
3 votes
1 answer
2k views

glusterfs mounts get unmounted when 1 of the 2 bricks goes offline

I have an odd case where 1 of the 2 replicated glusterfs bricks will go offline and take all of the client mounts down with it. As I understand it, this should not be happening. It should fail over ...
2 votes
2 answers
941 views

Can I directly alter files located in a GlusterFS brick

On a storage node, GlusterFS bricks (the physical disks composing a GlusterFS volume) are typically mounted at a specific location. For example: /export/glusterfs/<volume>/brick0/brick. However ...
1 vote
0 answers
54 views

Gluster replication / propagation to multiple remote servers

I'm new to the concept of Gluster, and I think I'm missing some key knowledge from Gluster documentation. In my company, there are 10 application servers each with their own storage, and the current ...
1 vote
1 answer
2k views

Cpu overuse replicating a Gluster Volume

I've this scenario: srv01 srv02 srv03 there is a gluster volume "vol1" running on srv03, and all the servers can use for i/o. vol1 contains a lot of mixed side images, ranging from few kbs to 3-4Mb, ...
0 votes
1 answer
3k views

Gluster and "failed to fetch volume file"

I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
2 votes
1 answer
2k views

GlusterFS not running on correct port! (peer disconnected / brick not starting)

On CentOS 7 witch two bricks on srv1 and srv2 I've upgraded gluster from 313 to 6 by using yum. I then rebooted server 1, started and mounted the drive successfully. This is my mount command: /usr/...
1 vote
0 answers
104 views

sync apache2 config directory with glusterfs and restart service on directory change

I am trying to create a small 3 node ha cluster with apache2, php, mariadb with galera, glusterfs, haproxy and keepalived on debian 11. I want to sync the majority of config files (which are the same ...
5 votes
2 answers
2k views

GlusterFS fails to mount on boot but mounts later in Ubuntu 12.04

Having two machines, profitmargin and revisionist, I created a volume in profitmargin: root@profitmargin:~# gluster volume info Volume Name: uploads Type: Distribute Status: Started Number of Bricks:...
6 votes
1 answer
19k views

GlusterFS Transport endpoint not connected from time to time

I'm using GlusterFS 3.7.9, currently on a single server with 4 bricks. Each brick has 4TB and the volume is set up as distribute only. The volume is mounted on a secondary server and I use it for ...
0 votes
1 answer
2k views

"gluster volume status" errors out

Our monitoring script runs: gluster volume status all and parses the output analyzing the volumes and the bricks. Of late one of the Gluster-servers here started replying to the above command with ...
1 vote
2 answers
700 views

Why does Gluster volume mount with only half capacity

Problem: A Distributed-Replicate Gluster volume only has half capacity. I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume. Both Gluster servers ...
0 votes
0 answers
95 views

Independent distributed FS for Linux with ACL

I have two Linux servers in two locations connected by VPN (over WAN - 100/100 Mb/s). On each of these servers is Samba DC (the same domain) and Samba File Server. Samba FS are configured to store ACL ...
3 votes
0 answers
2k views

Gluster Performance

currently I try to setup a Gluster cluster and the performance is strange and I'm not sure, if I configured something wron. I'm using 4x Hetzner root server running Debian Buster with Intel i7, 128GB ...
2 votes
1 answer
1k views

What are the "alternatives" to Heketi for Kubernetes?

I have built a working GlusterFS cluster, and now I want to make a Kubernetes StorageClass that uses it. I see a number of tutorials and documentation pointing to Heketi as the provisioner engine. ...
2 votes
1 answer
1k views

Certain operations like 'ls' hang in 4-node gluster setup

I have a 4-node gluster setup with replication set to 2. The 'ls' command hangs on the Gluster mount that I have created. The other operations such as creating a file or reading a file work fine. ...
1 vote
2 answers
7k views

the file-system of kvm virtual machine went to read-only after live migration

I setup my kvm virtualization environment with GlusterFS, the topology as follows: KVM1 ---------- KVM2 --------------KVM3 |----------------------|-------------------------| -----------------------|...
0 votes
0 answers
238 views

Debian gluster install doesn't work in Ubuntu 20.04

Following the instructions to add the gluster PPA to my Ubuntu 20.04 system, I get the following error when doing the apt update command: Ign:5 https://download.gluster.org/pub/gluster/glusterfs/...
0 votes
1 answer
831 views

How can I split a zfs pool for storing VMs and Glusterfs separately on Proxmox?

I have a ProxmoxVE server which I created the following zpool on: root@thor:\~# zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT Asgard 5.45T 816K ...
1 vote
0 answers
1k views

How to remove brick from failed Gluster peer?

I have a host that is damaged and is marked as Disconnected in the pool list. To remove the host and replace it I need to remove the brick. Info of my bricks: Volume Name: myvol Type: Distributed-...
0 votes
1 answer
2k views

How to force delete directory backed by Gluster that will not delete even when using -r option

Hi trying to delete a directory and no mater what I try I get: rm: cannot remove 'wont_delete/delete': Directory not empty I'm running sudo rm -vr wont_delete/ The directory is on gluster fs. Edit: ...
0 votes
3 answers
1k views

Data resiliency in Ceph or Gluster

Say I am most concerned with keeping my data safe from physical hard drive failure and the computer it connects to directly. RAID1 and RAID5 I understand. They provide protections against data loss ...
4 votes
2 answers
2k views

glusterfs and dovecot problems

Ive got two servers with a shared glusterfs disk, both running dovecot and serving mail from this shared disk. Users read mail only from one of these servers but mail gets delivered to both. ...
2 votes
0 answers
3k views

Glusterfs - Clients randomly disconnect until volume is restarted

Ubuntu 18.04 Glusterfs-7.0 I have created a volume for my file share and started it: sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2 sudo gluster ...
9 votes
2 answers
11k views

GlusterFS is failing to mount on boot

I'm running the official GlusterFS 3.5 packages on an Ubuntu 12.04 box that is acting as both, client and server, and everything seems to be working fine, except mounting the GlusterFS volumes at boot ...
8 votes
7 answers
21k views

GlusterFS failing to mount at boot with Ubuntu 14.04

Previously I asked about mounting GlusterFS at boot in an Ubuntu 12.04 server and the answer was that this was buggy in 12.04 and worked in 14.04. Curious I gave it a try on a virtual machine running ...
2 votes
0 answers
421 views

GlusterFS volume stalls / blocks after quick access for PHP session files from PHP Docker container

2021-10-05 UPDATED QUESTION AND TEXT AFTER MORE ANALYSIS, STRIPPED DOWN TO MINIMAL CASE Short description A Nomad / Consul cluster is running, with Traefik (with minimal configuration) as a system ...
0 votes
2 answers
3k views

GlusterFS SSL not working

I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me. I have tried it the simple way: openssl genrsa -out glusterfs.key ...

1
2 3 4 5
7