Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
322
questions
0
votes
0
answers
13
views
Setting up OCFS2 on RockyLinux
anyone has experienced OCFS2 fs on RockyLinux 8.5?
I'm searching a solution to sharing a single iscsi LUN between multiples server, but I didn't find any useful info.
I read about GFS2, but appears to ...
- 101
0
votes
0
answers
8
views
Distributed Gluster volume mounts with half size
I am currently trying to setup a distributed GlusterFS volume. I have added the bricks successfully and have created the volume:
Status of volume: storagePool
------------------------------------------...
- 101
1
vote
0
answers
36
views
What are the "alternatives" to Heketi for Kubernetes?
I have built a working GlusterFS cluster, and now I want to make a Kubernetes StorageClass that uses it. I see a number of tutorials and documentation pointing to Heketi as the provisioner engine.
...
- 612
0
votes
0
answers
19
views
Debian gluster install doesn't work in Ubuntu 20.04
Following the instructions to add the gluster PPA to my Ubuntu 20.04 system, I get the following error when doing the apt update command:
Ign:5 https://download.gluster.org/pub/gluster/glusterfs/...
- 612
0
votes
1
answer
71
views
How can I split a zfs pool for storing VMs and Glusterfs separately on Proxmox?
I have a ProxmoxVE server which I created the following zpool on:
root@thor:\~# zpool list
NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
Asgard 5.45T 816K ...
- 101
0
votes
0
answers
36
views
GlusterFS : How to change the ip used by servers while in production?
I have a 4 nodes Proxmox cluster in which each member is connected to the network by a single Gigabit Ethernet socket.
In this cluster, I have a GlusterFS with 3 volumes installed on the proxmox hosts ...
1
vote
0
answers
102
views
How to remove brick from failed Gluster peer?
I have a host that is damaged and is marked as Disconnected in the pool list. To remove the host and replace it I need to remove the brick.
Info of my bricks:
Volume Name: myvol
Type: Distributed-...
- 273
0
votes
1
answer
170
views
How to force delete directory backed by Gluster that will not delete even when using -r option
Hi trying to delete a directory and no mater what I try I get: rm: cannot remove 'wont_delete/delete': Directory not empty
I'm running sudo rm -vr wont_delete/
The directory is on gluster fs.
Edit: ...
- 273
0
votes
0
answers
23
views
Gluster USER SERVICEABLE SNAPSHOTS: Cannot see `.snaps` directory
Sorry for disturbing you... Uh, I met a very strange GlusterFS problem: I can access snapshots by using FUSE mount and it works fine. However, when I test Gluster USER-SERVICEABLE snapshots feature, I ...
- 1
0
votes
0
answers
79
views
Gluster mount keeps crashing
I'm running a small set of Docker Swarm nodes on Raspberry Pis, and using glusterfs as shared storage for the docker volumes. I originally set this up while on Ubuntu Server 21.04 (hirsute) which has ...
- 650
0
votes
0
answers
24
views
persistent volume for a SaaS project on docker Swarm & ON MY OWN Servers / VPS (non-AWS, non-Azure): what to use for the MySQL & for the file-uploads?
I am not sure, what architecture / which way to go for the persistent data of my docker Swarm SaaS webapp.
A draft of the layout with traefik_proxy and some context for a better understanding of my ...
- 1
0
votes
0
answers
45
views
is it safe to run GlusterFS node inside Docker?
I have multiple Synology NAS and I would like to have a HA storage.
I already use Synology app called "Synology High Availability" which works well, but require specific hardware.
I would ...
- 133
0
votes
0
answers
220
views
XFS (dm-11): writeback error on sector
I am continously getting the following error :
XFS (dm-11): writeback error on sector xxx
I can't find how to fix the issue neither what is causing it.
My environnent: an ovirt (4.3.8) cluster, with ...
2
votes
0
answers
176
views
GlusterFS volume stalls / blocks after quick access for PHP session files from PHP Docker container
2021-10-05 UPDATED QUESTION AND TEXT AFTER MORE ANALYSIS, STRIPPED DOWN TO MINIMAL CASE
Short description
A Nomad / Consul cluster is running, with Traefik (with minimal configuration) as a system ...
- 51
0
votes
0
answers
25
views
GlusterFS breaking frequently
I would like to ask for guidance on what I might be wrong.
I have a Swarm cluster with three nodes, and a GlusterFS server (no bricks or replication). All nodes have volume mounted by glusterfs client....
0
votes
0
answers
22
views
storing and orchestrating geographically distributed files
Could somebody explain how corporations like facebook and instagram (or literary anyone who stores the user data) technically handle storage of EU citizen data in Europe?
I am building a website that ...
- 103
2
votes
0
answers
635
views
Glusterfs on Synology NAS?
I run a machine-learning cluster for my small business. The cluster consists of three Ubuntu servers. The 10TB /home directory, provided by Server 1, is shared across all servers and is almost full.
I'...
- 21
0
votes
1
answer
115
views
How to mount glusterfs at boot in centOS 7 lxc container?
Need to get a glusterfs volume mounted in a centos 7 lxc container.
found this and can do it manually ok...
But it seems that adding it in the fstab doesnt work because it gets executed before gluster ...
- 31
2
votes
0
answers
217
views
I'm looking for a way to configure distance clustering of postfix and dovecot
I currently have a postfix server and dovecot server sharing files from an NFS server in the UK and the same config in Switzerland. I tried to mailsync but that appeared to lose emails, so then I ...
- 600
1
vote
0
answers
28
views
GlusterFS not Sync geo
I activated GlusterFS synchronization with master/slave geo location.
At first everything working, however elw does not synchronize new files, only if I stop and delete-sync-time.
The number of ...
3
votes
1
answer
892
views
Zero downtime with Kubernetes on top of GlusterFs on top of a ZFS raid - Is this the best solution?
TL;DR
A client requests me to make a robust system to run containerized microservices within their LAN.
Restriction: They give me 2 machines and 6 data-disks. No more hardware. I have to build "...
- 235
0
votes
0
answers
90
views
Glusterfs: rpc actor failed to complete successfully
I have glusterfs service running over CentOS 6, an I can see those errors filling up the logs continuously:
[2021-03-09 07:13:52.692995] E [rpcsvc.c:450:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc ...
- 107
1
vote
1
answer
148
views
Can I directly alter files located in a GlusterFS brick
On a storage node, GlusterFS bricks (the physical disks composing a GlusterFS volume) are typically mounted at a specific location. For example: /export/glusterfs/<volume>/brick0/brick.
However ...
- 1,554
1
vote
1
answer
473
views
Heketi - adding device with existing data
I have an OKD cluster with GlusterFS as a storage class and Heketi as a frontend. Everything works fine till destroy of the Heketi database. Now I can't make any changes to the storage, I can't add ...
- 456
1
vote
0
answers
39
views
Heavy network usage withg GlusterFS FUSE client
I have a simple GlusterFS 7.2 setup with 3 servers:
data1 and data2 contribute several bricks (4 each) to a distributed replicated GlusterFS volume.
host1 uses the GlusterFS FUSE client to mount the ...
- 11
2
votes
0
answers
612
views
Gluster Performance
currently I try to setup a Gluster cluster and the performance is strange and I'm not sure, if I configured something wron. I'm using 4x Hetzner root server running Debian Buster with Intel i7, 128GB ...
- 388
0
votes
1
answer
119
views
GlusterFS - Define Failover Cluster
I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a ...
- 1
0
votes
1
answer
538
views
Numbers of bricks is not a multiple of replica count - glusterfs
I have 10 servers and want to use all as storage so tried to create volume with following command but its throwing error
gluster volume create gv0 replica 3 server1:/data/brick1/gv0 server2:/data/...
- 105
0
votes
0
answers
615
views
CentOS 7 - GlusterFS & Pacemaker & Corosync
I try to install a little GlusterFS (for NFS) Cluster with CentOS High Availability.
I have really no idea why it failed. I started multiple times from scratch. My problem is, that I can't see any ...
- 115
0
votes
3
answers
709
views
Data resiliency in Ceph or Gluster
Say I am most concerned with keeping my data safe from physical hard drive failure and the computer it connects to directly.
RAID1 and RAID5 I understand. They provide protections against data loss ...
- 41
1
vote
0
answers
114
views
Single Gluster peer rebalancing inconsistently
I have a pool of 5 Gluster servers with individual bricks for a volume operating in Dispersed mode, to which I have added an extra 5 peers with individual bricks in another datacenter, making this ...
- 33
1
vote
0
answers
32
views
Optimal volume setup in Glusterfs
I have a number of servers and am wondering what the most optimal volume setup would be. Initially, there'll be 5 servers but over 20 later on. Each server has 16 x 3TB drives.
Essentially, I want to ...
- 85
3
votes
3
answers
1k
views
Glusterfs on web server
I want to build a HA Web service and I was planning to use Glusterfs on three nodes (with replica 3).
My plan was to install web server directly on Gluster nodes.
Is this a viable solution or is there ...
- 33
2
votes
1
answer
858
views
How should I recover from Ovirt and GlusterFS partial failure?
I am managing a 3 node Ovirt 4.3.7 cluster with a hosted engine appliance; the nodes are also glusterfs nodes. The systems are:
ovirt1 (node at 192.168.40.193)
ovirt2 (node at 192.168.40.194)
ovirt3 (...
- 131
0
votes
2
answers
613
views
CTDB Samba script failing to start
Here is the output from a tail -f /var/log/ctdb/log.ctdb
2020/01/27 18:52:52.317670 ctdbd[3330]: Running the "startup" event.
2020/01/27 18:53:22.323208 ctdbd[3330]: startup event failed
2020/01/27 ...
- 101
1
vote
1
answer
463
views
GlusterFS Volume Creation Suggestion
I have to deploy multiple Openshift Clusters from 3 nodes to 10 nodes. For 3 nodes i am creating volumes as replicated.
But for 4 and above it doesn't look nice to create replicated volume, so each ...
- 105
0
votes
1
answer
379
views
HAProxy + Dovecot + Gluster
I'm looking to setup 2 dovecot servers behind HAProxy using gluster for a high-availability solution. From the reading I've been doing, it seems that dovecot highly suggests the use of the dovecot ...
- 229
1
vote
0
answers
2k
views
Glusterfs - Clients randomly disconnect until volume is restarted
Ubuntu 18.04
Glusterfs-7.0
I have created a volume for my file share and started it:
sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2
sudo gluster ...
- 25
1
vote
2
answers
573
views
K3S arm64 distributed files systems
I deployed a K3S Cluster on arm64 and I need to have a DFS directly on-premise, It will be better to have it running on the kubernetes stack.
Regarding DFS choices there are some options, but...:
...
- 113
0
votes
0
answers
78
views
Should I use GlusterFS for mail server?
I'm planing to use GlusterFS for my mail server. But I read that GlusterFS have problems with small file ( and mail are small files). What's the problems with GlusterFS when come to working with small ...
- 191
0
votes
1
answer
35
views
How to test and evaluate performent of a storage system? Compare between NFS and GlusterFS?
I have an exercise at school about the title question,I have google search for couple of hours but I'm not found anythings useful.
I only know that when come to HA, GlusterFS remove the single point ...
- 191
1
vote
2
answers
893
views
GlusterFS or Ceph RBD for storing Virtual Machine image
I am using glusterfs 5.3 for storing images of virtual machines in Cloudstack/KVM environment, majority of VMs are DB Servers (Sql Server & MariaDB). But I am facing performance issue on VMs ...
- 11
3
votes
0
answers
1k
views
Previously mountable GlusterFS volume now fails to mount with several errors
I've previously set up a couple of GlusterFS volumes (called cyclorana0 and cyclorana1) across two nodes (with IPs 10.0.2.4 (hostname alboguttata) and 10.0.2.5 (hostname verrucosa)) on my LAN. The ...
- 835
1
vote
1
answer
3k
views
Chossing between GlusterFS replica 2 or 3
I can't figure out the relation between the number of bricks and replica count.
I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
- 137
0
votes
0
answers
70
views
What could cause a mount to suddenly unmount?
I have been running glusterfs 3.4 in AWS for a couple months now, over the past month the glusterfs mount has disappeared from the gluster client server.
Stats from the client server seem normal,
...
- 128
2
votes
1
answer
1k
views
GlusterFS not running on correct port! (peer disconnected / brick not starting)
On CentOS 7 witch two bricks on srv1 and srv2
I've upgraded gluster from 313 to 6 by using yum. I then rebooted server 1, started and mounted the drive successfully.
This is my mount command:
/usr/...
- 21
0
votes
1
answer
75
views
K8S: securing GlusterFS
I have a question on how to divide access to the same gluster for different K8S namespaces. Let's say, I have 3 different volumes (vol-a, vol-b, vol-c) in a gluster and I'd like to permit access to ...
- 527
1
vote
0
answers
189
views
Glusterfs support for user namespaces
I have a gluster volume mounted on a host machine and tried to run a namespaced docker container with a bind mount from the gluster mount on the host.
It seems that the user namespacing is not ...
- 194
2
votes
0
answers
31
views
Is it possible to recover a previously used brick in the same volume? Is it better to reuse it or clear and add as new?
Was testing how glusterfs behaves after an HDD crash and came to this issue where a previously used but not corrupted brick cannot be added back to a volume because glusterfs thinks it already is part ...
- 151
0
votes
1
answer
584
views
Can't enable NFS on two-node Ansible provisioned GlusterFS cluster
I have two nodes (running Armbian Bionic, based on Ubuntu 18.04) set up to create a distributed Gluster storage, provisioned via Ansible.
I think the relevant part of the Ansible playbook is this:
...
- 835