Skip to main content

Questions tagged [glusterfs]

GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.

Filter by
Sorted by
Tagged with
2 votes
1 answer
227 views

Gluster: How to replace a brick in a dispersed volume?

I set up a 4+2 dispersed volume. It worked well so far. gluster volume info Volume Name: disperseVol Type: Disperse Volume ID: 35386b55-829c-4bac-bdba-609427269cf4 Status: Started Snapshot Count: 0 ...
Thomas P's user avatar
0 votes
0 answers
36 views

Can glusterfs events APIs be used to warn of fs file changes?

My team is about to install glusterfd on our server infrastructure. I need to monitor when a file is added or deleted from the fs and call a url with the file name when this happens. Can this be done ...
Nelson Teixeira's user avatar
1 vote
0 answers
28 views

GlusterFS Critical Error: Negative fsal_fd_global_counter Freezes NFS Shares - Seeking Root Cause and Resolution

I'm encountering a critical issue in my GlusterFS setup that is causing NFS share freezing, leading to significant production downtime. The logs indicate a recurring error message: 21/11/2023 16:03:34 ...
JannisDev's user avatar
0 votes
0 answers
112 views

How can I change a setting in the Glusterfs plugin for Docker?

I want to change a configuration in a docker plugin, I read this manual, and I use this command: docker plugin set glusterfs:latest Config.PropagatedMount=/opt/docker/data/427680.427680/volumes/ but I'...
Ali's user avatar
  • 121
4 votes
0 answers
126 views

Data Replication Approaches for Hot Standby Architecture

I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
Pacopenguin's user avatar
0 votes
0 answers
60 views

Failover and offline reads in GlusterFS?

I have a cluster, where all machines have the daemon running and the clients mounted. As far as I understand, only the machine where I run peer probe becomes the host. If a client goes down: the ...
Centaro's user avatar
  • 19
0 votes
1 answer
432 views

Postfix warning: not enough free space in mail queue

I have already checked the solutions at this post, but I can't find the reason. This is my situation: Running postfix inside a docker container (docker swarm). Docker container has no quota. /var/...
lepe's user avatar
  • 469
1 vote
0 answers
45 views

How do I restrict some directories to some clients in GlusterFS?

GlusterFS makes it possible with auth.ssl-allow option to allow or deny access to given volumes for a given client, identified by its SSL certificate, but the access is global: either the client has ...
Arseni Mourzenko's user avatar
0 votes
0 answers
76 views

How to mount glusterfs based san lun on another server and mount with ext4/xfs filesystem

I have one glusterfs based filesystem san lun with some data assigned to linux server and want to access that data on that server. What are the possible ways to recover that data? Tried to mount it ...
Sachin Kadam's user avatar
3 votes
1 answer
234 views

Howto: Block or File replication across 3+ nodes without a SAN

The setup I admin the backend for a website that currently exists on a single node using Nginx (webserver), Neo4J (database) and Wildfly (app server). The website is getting enough traffic that we ...
SiegeX's user avatar
  • 587
0 votes
1 answer
912 views

Filter groups that SSSD receives from AD server

We've got two Ubuntu 22.04 servers that use Kerberos and SSSD to authenticate users against an AD server. This works great. The servers also have a GlusterFS volume that holds the user's home ...
user7037's user avatar
2 votes
4 answers
905 views

Creating replicated gluster volume always gives Distributed-Replicate volume

Peace upon you, I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume i followed the following commands Pool Peers root@tiny1:~# gluster peer status ...
Yassine Chilali's user avatar
1 vote
0 answers
70 views

Gluster replication / propagation to multiple remote servers

I'm new to the concept of Gluster, and I think I'm missing some key knowledge from Gluster documentation. In my company, there are 10 application servers each with their own storage, and the current ...
hafwan's user avatar
  • 23
1 vote
0 answers
106 views

sync apache2 config directory with glusterfs and restart service on directory change

I am trying to create a small 3 node ha cluster with apache2, php, mariadb with galera, glusterfs, haproxy and keepalived on debian 11. I want to sync the majority of config files (which are the same ...
icabraja's user avatar
0 votes
0 answers
101 views

Independent distributed FS for Linux with ACL

I have two Linux servers in two locations connected by VPN (over WAN - 100/100 Mb/s). On each of these servers is Samba DC (the same domain) and Samba File Server. Samba FS are configured to store ACL ...
Moses's user avatar
  • 1
2 votes
1 answer
1k views

What are the "alternatives" to Heketi for Kubernetes?

I have built a working GlusterFS cluster, and now I want to make a Kubernetes StorageClass that uses it. I see a number of tutorials and documentation pointing to Heketi as the provisioner engine. ...
AlanObject's user avatar
0 votes
0 answers
254 views

Debian gluster install doesn't work in Ubuntu 20.04

Following the instructions to add the gluster PPA to my Ubuntu 20.04 system, I get the following error when doing the apt update command: Ign:5 https://download.gluster.org/pub/gluster/glusterfs/...
AlanObject's user avatar
0 votes
1 answer
853 views

How can I split a zfs pool for storing VMs and Glusterfs separately on Proxmox?

I have a ProxmoxVE server which I created the following zpool on: root@thor:\~# zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT Asgard 5.45T 816K ...
mikeLundquist's user avatar
1 vote
0 answers
1k views

How to remove brick from failed Gluster peer?

I have a host that is damaged and is marked as Disconnected in the pool list. To remove the host and replace it I need to remove the brick. Info of my bricks: Volume Name: myvol Type: Distributed-...
user432024's user avatar
0 votes
1 answer
2k views

How to force delete directory backed by Gluster that will not delete even when using -r option

Hi trying to delete a directory and no mater what I try I get: rm: cannot remove 'wont_delete/delete': Directory not empty I'm running sudo rm -vr wont_delete/ The directory is on gluster fs. Edit: ...
user432024's user avatar
2 votes
0 answers
435 views

GlusterFS volume stalls / blocks after quick access for PHP session files from PHP Docker container

2021-10-05 UPDATED QUESTION AND TEXT AFTER MORE ANALYSIS, STRIPPED DOWN TO MINIMAL CASE Short description A Nomad / Consul cluster is running, with Traefik (with minimal configuration) as a system ...
Paul's user avatar
  • 51
2 votes
0 answers
2k views

Glusterfs on Synology NAS?

I run a machine-learning cluster for my small business. The cluster consists of three Ubuntu servers. The 10TB /home directory, provided by Server 1, is shared across all servers and is almost full. I'...
SoCold's user avatar
  • 21
0 votes
1 answer
357 views

How to mount glusterfs at boot in centOS 7 lxc container?

Need to get a glusterfs volume mounted in a centos 7 lxc container. found this and can do it manually ok... But it seems that adding it in the fstab doesnt work because it gets executed before gluster ...
user64's user avatar
  • 31
2 votes
0 answers
582 views

I'm looking for a way to configure distance clustering of postfix and dovecot

I currently have a postfix server and dovecot server sharing files from an NFS server in the UK and the same config in Switzerland. I tried to mailsync but that appeared to lose emails, so then I ...
banjo67xxx's user avatar
1 vote
0 answers
122 views

GlusterFS not Sync geo

I activated GlusterFS synchronization with master/slave geo location. At first everything working, however elw does not synchronize new files, only if I stop and delete-sync-time. The number of ...
Rafael Arcanjo's user avatar
3 votes
1 answer
2k views

Zero downtime with Kubernetes on top of GlusterFs on top of a ZFS raid - Is this the best solution?

TL;DR A client requests me to make a robust system to run containerized microservices within their LAN. Restriction: They give me 2 machines and 6 data-disks. No more hardware. I have to build "...
Xavi Montero's user avatar
0 votes
0 answers
164 views

Glusterfs: rpc actor failed to complete successfully

I have glusterfs service running over CentOS 6, an I can see those errors filling up the logs continuously: [2021-03-09 07:13:52.692995] E [rpcsvc.c:450:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc ...
Eng7's user avatar
  • 137
2 votes
2 answers
1k views

Can I directly alter files located in a GlusterFS brick

On a storage node, GlusterFS bricks (the physical disks composing a GlusterFS volume) are typically mounted at a specific location. For example: /export/glusterfs/<volume>/brick0/brick. However ...
Spack's user avatar
  • 1,624
1 vote
1 answer
794 views

Heketi - adding device with existing data

I have an OKD cluster with GlusterFS as a storage class and Heketi as a frontend. Everything works fine till destroy of the Heketi database. Now I can't make any changes to the storage, I can't add ...
QkiZ's user avatar
  • 692
1 vote
0 answers
103 views

Heavy network usage withg GlusterFS FUSE client

I have a simple GlusterFS 7.2 setup with 3 servers: data1 and data2 contribute several bricks (4 each) to a distributed replicated GlusterFS volume. host1 uses the GlusterFS FUSE client to mount the ...
Ben's user avatar
  • 111
3 votes
0 answers
2k views

Gluster Performance

currently I try to setup a Gluster cluster and the performance is strange and I'm not sure, if I configured something wron. I'm using 4x Hetzner root server running Debian Buster with Intel i7, 128GB ...
TRW's user avatar
  • 528
0 votes
1 answer
187 views

GlusterFS - Define Failover Cluster

I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a ...
dr-ing's user avatar
  • 1
0 votes
1 answer
1k views

Numbers of bricks is not a multiple of replica count - glusterfs

I have 10 servers and want to use all as storage so tried to create volume with following command but its throwing error gluster volume create gv0 replica 3 server1:/data/brick1/gv0 server2:/data/...
ImranRazaKhan's user avatar
0 votes
0 answers
1k views

CentOS 7 - GlusterFS & Pacemaker & Corosync

I try to install a little GlusterFS (for NFS) Cluster with CentOS High Availability. I have really no idea why it failed. I started multiple times from scratch. My problem is, that I can't see any ...
j0k4b0's user avatar
  • 115
0 votes
3 answers
2k views

Data resiliency in Ceph or Gluster

Say I am most concerned with keeping my data safe from physical hard drive failure and the computer it connects to directly. RAID1 and RAID5 I understand. They provide protections against data loss ...
Dave Pearce's user avatar
1 vote
0 answers
273 views

Single Gluster peer rebalancing inconsistently

I have a pool of 5 Gluster servers with individual bricks for a volume operating in Dispersed mode, to which I have added an extra 5 peers with individual bricks in another datacenter, making this ...
example6's user avatar
1 vote
0 answers
71 views

Optimal volume setup in Glusterfs

I have a number of servers and am wondering what the most optimal volume setup would be. Initially, there'll be 5 servers but over 20 later on. Each server has 16 x 3TB drives. Essentially, I want to ...
Gaspode's user avatar
  • 95
3 votes
3 answers
2k views

Glusterfs on web server

I want to build a HA Web service and I was planning to use Glusterfs on three nodes (with replica 3). My plan was to install web server directly on Gluster nodes. Is this a viable solution or is there ...
P. P.'s user avatar
  • 33
2 votes
1 answer
1k views

How should I recover from Ovirt and GlusterFS partial failure?

I am managing a 3 node Ovirt 4.3.7 cluster with a hosted engine appliance; the nodes are also glusterfs nodes. The systems are: ovirt1 (node at 192.168.40.193) ovirt2 (node at 192.168.40.194) ovirt3 (...
Randall's user avatar
  • 131
0 votes
2 answers
989 views

CTDB Samba script failing to start

Here is the output from a tail -f /var/log/ctdb/log.ctdb 2020/01/27 18:52:52.317670 ctdbd[3330]: Running the "startup" event. 2020/01/27 18:53:22.323208 ctdbd[3330]: startup event failed 2020/01/27 ...
hcker2000's user avatar
  • 101
1 vote
1 answer
889 views

GlusterFS Volume Creation Suggestion

I have to deploy multiple Openshift Clusters from 3 nodes to 10 nodes. For 3 nodes i am creating volumes as replicated. But for 4 and above it doesn't look nice to create replicated volume, so each ...
ImranRazaKhan's user avatar
0 votes
1 answer
683 views

HAProxy + Dovecot + Gluster

I'm looking to setup 2 dovecot servers behind HAProxy using gluster for a high-availability solution. From the reading I've been doing, it seems that dovecot highly suggests the use of the dovecot ...
Aaron A's user avatar
  • 249
2 votes
0 answers
3k views

Glusterfs - Clients randomly disconnect until volume is restarted

Ubuntu 18.04 Glusterfs-7.0 I have created a volume for my file share and started it: sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2 sudo gluster ...
Gallardo994's user avatar
1 vote
2 answers
670 views

K3S arm64 distributed files systems

I deployed a K3S Cluster on arm64 and I need to have a DFS directly on-premise, It will be better to have it running on the kubernetes stack. Regarding DFS choices there are some options, but...: ...
GoA Oz's user avatar
  • 113
1 vote
0 answers
138 views

Should I use GlusterFS for mail server?

I'm planing to use GlusterFS for my mail server. But I read that GlusterFS have problems with small file ( and mail are small files). What's the problems with GlusterFS when come to working with small ...
Lê Minh Quân's user avatar
0 votes
1 answer
67 views

How to test and evaluate performent of a storage system? Compare between NFS and GlusterFS?

I have an exercise at school about the title question,I have google search for couple of hours but I'm not found anythings useful. I only know that when come to HA, GlusterFS remove the single point ...
Lê Minh Quân's user avatar
1 vote
2 answers
1k views

GlusterFS or Ceph RBD for storing Virtual Machine image

I am using glusterfs 5.3 for storing images of virtual machines in Cloudstack/KVM environment, majority of VMs are DB Servers (Sql Server & MariaDB). But I am facing performance issue on VMs ...
Prateek's user avatar
  • 11
4 votes
0 answers
3k views

Previously mountable GlusterFS volume now fails to mount with several errors

I've previously set up a couple of GlusterFS volumes (called cyclorana0 and cyclorana1) across two nodes (with IPs 10.0.2.4 (hostname alboguttata) and 10.0.2.5 (hostname verrucosa)) on my LAN. The ...
hpy's user avatar
  • 875
1 vote
1 answer
4k views

Choosing between GlusterFS replica 2 or 3

I can't figure out the relation between the number of bricks and replica count. I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
bulkmoustache's user avatar
0 votes
0 answers
148 views

What could cause a mount to suddenly unmount?

I have been running glusterfs 3.4 in AWS for a couple months now, over the past month the glusterfs mount has disappeared from the gluster client server. Stats from the client server seem normal, ...
Ron Russey's user avatar

1
2 3 4 5
7