Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
1
vote
0answers
11 views
Glusterfs dont mirror supposed mirrored folder
Gluster dont replicate mirrored content:
xfce4-terminal -T LocalTerm
exit
At LocalTerm:
PS1='[\u@\h]-[\D{%T}]-[\W] => '
lxc profile copy default default-bkp
lxc profile set default raw....
-1
votes
0answers
11 views
Drupal HA infrastructure
What is the best way to create a Drupal high availability infrastructure?
I'm thinking this infrastructure:
2 frontEnd load balanced: apache/nginx, php-fpm, glusterfs, drupal
3 backend: galera ...
0
votes
0answers
16 views
mount problems with keepalived, glusterfs and nfs-ganesha
I installed glusterfs, keepalived (using one VIP for both servers) and nfs-ganesha on two servers.
So far, everything is working. But there is a problem when I try to mount from a third server:
When ...
0
votes
0answers
11 views
Slow gluster (auto)mount when a server is down
I have a gluster cluster formed by 3 servers : gfs1, gfs2 and gfs3 ( Type: Replicate , Number of Bricks: 1 x 3 = 3 ) .
I'm testing the usage from a 4th server.
When everything is up manual&auto ...
1
vote
4answers
87 views
Best solution for docker volume persistance [closed]
I'd like to setup proper way to persist docker volumes.
Currently all our docker volumes are local only, so in case of server failure our data are lost.
I'm thinking about buying two servers and ...
google-cloud-platform
0
votes
1answer
23 views
GlusterFS memory leak
I am using glusterfs on Kubernetes for about 7GB of storage. I have 4 nodes, two of which are holding the replica sets. One of the nodes has a constant memory leak. Starts out at about 100MB then ...
0
votes
0answers
10 views
Moving to GlusterFS from Lsync - Worths my case?
We are balancing our website traffic onto two simple LAMP servers with the help of a load balancer in front.
We are using MySQL replication for the database and Lsync daemon for syncing files.
We ...
-2
votes
1answer
99 views
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers.
Need test the solution locally before install it on prodution and even ...
0
votes
0answers
8 views
Resource requirements for glusterfs [duplicate]
We are running 2 gluster nodes in Gcloud with below specs.
Spec of one gluster node.
8 vcpus/30GB RAM. 8TB HDD with 750GB SSD used as Bcache.
Currently using Ubuntu, but we have plans of moving to ...
2
votes
1answer
36 views
Does glusterFS allow you to use multiple “classes” of storage?
I am used to traditional SANs. On a traditional SAN, we're able to create tiers of storage (fast disks, slow disks), and then allocate volumes from those tiers of storage. This way a device that needs ...
0
votes
1answer
82 views
Glusterfs brick size
I'm trying to deploy a gluster cluster with 12 nodes with 10 TB each one, but when I create the volume each brick is created with only 50GB, it must have the entire disk space i suppose. This is my ...
0
votes
1answer
42 views
glusterfs client mount point fails with 'Client quorum is not met'
Assume a basic replica 3 arbiter 1 configuration, glusterfs-server 4.0.2 and glusterfs-client 4.0.2.
glusterfs-client is installed on Ubuntu 18.04.
In order to verify that write / read ops are ...
0
votes
1answer
535 views
peer probe: failed: Probe returned with Transport endpoint is not connacted
I want to create 2 server glusterfs but I don't know why when I run command gluster peer probe server1 they have error. Firewalld is active.
# gluster peer probe server1
peer probe: fail: Probe ...
1
vote
2answers
67 views
Filesystem Test for Contended Writes
I have been using a suite of filesystem testing tools to benchmark and abuse a GlusterFS volume. The volume is a replica 3 volume spread out over 6 hosts.
Fio, iozone, and Bonnie indicate to me that ...
1
vote
2answers
112 views
Glusterfs can't set xattr security.selinux
I'm currently trying to use Gluster as storage for docker volumes on Centos 7.
The gluster version is 4.0.2.
On creation of the volume the files from the container are copied to the new volume. The ...
1
vote
1answer
50 views
Glusterfs 2x server issue
I am having almost identical issue, while so can provide more details on how the set up is:
2x server replica 2 gluster volume from two bricks. Brick
IMG-01:/images/storage/brick1 49152 ...
0
votes
1answer
203 views
Gluster and “failed to fetch volume file”
I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
0
votes
0answers
16 views
Do I need to set up quorum in a 2x replicated glusterfs servers?
I am seeing a weird issue on a 2x replicated glusterfs servers. While all the status and volume info for glusterfs shows correctly set and running and up status; writing on one server is not ...
0
votes
0answers
20 views
Can a Gluster node stay operational when completely isolated from other nodes?
I'm trying to cut down storage expences on a virtual hosting by keeping rarely used files on my own physical PC.
The main requirement: when a network problem occurs, it is ok to not be able to read ...
0
votes
1answer
131 views
Gluster snapshot directory error: Transport endpoint is not connected
When I try to access the snapshot directory for a volume, I keep getting .snaps: Transport endpoint is not connected I killed and started the glusterd service but still keep getting that error message....
1
vote
0answers
44 views
how to solve glusterfs GFID split-brain
I have a glusterfs of three servers and after a bit of troubleshooting i concluded that a file has a gfid split-brain.
**Server1**
# file: srv/glusterfs/gbrick/file1
trusted.afr.dirty=...
1
vote
2answers
123 views
Can a single gluster brick be used with multiple volumes?
I know a volume can span multiple bricks. I was wondering is the converse true where a single brick is used with multiple volumes.
Or we should just use the subdir option.
3
votes
0answers
439 views
GlusterFS peer appears disconnected in one of the peers
I have am using a GlusterFS cluster with a Trusted Storage Pool consisting out of 4 peers.
example-prod (100.100.250.197)
example-storage1 (100.100.248.178)
example-storage2 (100.100.250.25)
example-...
-1
votes
1answer
102 views
mount glusterfs before nginx start after reboot
On Centos 7 after reboot
How can I make sure NGINX is only started after the glusterFS mount is completed?
I tried adding a line to rc.local but nginx fails to start and the directory is not mounted ...
0
votes
1answer
184 views
Why does Gluster volume mount with only half capacity
Problem: A Distributed-Replicate Gluster volume only has half capacity.
I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume.
Both Gluster servers ...
0
votes
1answer
395 views
Does GlusterFS require XFS or can it work with other file systems?
I am trying to install GlusterFS and I see all the instructions utilize the creation of an XFS mount point, is it a limitation that GlusterFS requires XFS? Can it work with vfat or ntfs mounts?
1
vote
1answer
217 views
Gluster Mount via Systemd
I need to get a gluster volume to mount on boot. Placing it in /etc/fstab does not produce reliable results.
I setup the following systemd service:
[Unit]
Description=Gluster Mount
[Service]
Type=...
1
vote
0answers
313 views
Write speed of gluster volume reduced over time
I have a gluster volume with the following configuration.
~~~~~~~~~~~~~~~~~~~~~
Number of Bricks: 9
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 3 = 3
Cold Tier:...
0
votes
0answers
416 views
Glusterfs poor performance on Ovirt
We've setup an Ovirt Cluster based on Gluster filesystem.
There is 51 vms (mixed environments windows,linux,bsd and so on) on Gluster Data Domain.
At some hours of the day we saw "Disk I/O is ...
0
votes
0answers
23 views
Stop polkit from changing permission on bricks CentOS7
After a period of time all the files and directories under my bricks change to polkitd.ssh_keys
I'm not sure the 'proper' way to tell polkit to go away from my bricks, I have the user.group I need ...
0
votes
0answers
102 views
Gluster mount shows question marks for new files permissions
I have a Gluster volume mounted on two servers.
If I create a file on server a and do an ls -l on server b I see the following
-????????? ? ? ? ? ? test321.svg
The same ls on server a
-rw-r--r-- ...
0
votes
1answer
555 views
How to delete thin volumes from an overcomitted LVM thin pool
So i have a LVM thin pool (used for glusterfs with snapshots) that got overcommitted and now has metadata read-only (M attribute). There are a few snapshot lvs left on the pool (gluster created those ...
3
votes
0answers
355 views
CTDB Samba failover not highly available
TL;DR
Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection.
here and here state there is work in progress to make this possible
here states it is ...
0
votes
1answer
179 views
Can not change SELinux security context on Gluster FS folder
I can not change the security context of a folder which is created inside a Gluster-FS volume. Following is the error I keep getting.
chcon: failed to change context of ‘test’ to ‘system_u:object_r:...
4
votes
0answers
1k views
excessive glusterfs memory usage
I run a 3-node glusterfs 3.10 cluster based on Heketi to automatically provision and deprovision storage via Kubernetes. Currently, there are 20 volumes active - most with the minimum allowed size of ...
0
votes
2answers
664 views
GlusterFs - remove and Add brick is not possible
I have a GlusterFS (3.12.1) cluster of 3 nodes.
Setp 1: removed a node (node2)
from node1
# gluster volume remove-brick swarm-data replica 2 node2:/glusterfs/swarm-data force
# gluster peer ...
1
vote
1answer
263 views
Retry all failed mounts with systemd
I created several GlusterFS volumes replicated over 9 machines. All of the mounts (128 to be exact) are managed by systemd.
The systemctl command shows a random subset of the mounts as "failed" (see ...
4
votes
2answers
392 views
Identifying cause of GlusterFS data corruption
I have been experiencing data corruption when writing data to a replicated GlusterFS volume I have configured across two servers.
The configuration I have set up is as follows:
Servers are running ...
1
vote
0answers
100 views
glusterfs mkfifo permission denied
I have a glusterfs volume. I can write files to it just fine, but when I am trying to create a pipe, it gives me permission denied.
[2017-09-30 15:57:57.148455] E [MSGID: 114031] [client-rpc-fops.c:...
0
votes
0answers
210 views
Network based file system for small files ( cache files )
I'm planning on moving nginx cache to a network based storage and my main concern is choosing a network based file system that has good performance and low latency .
I've seen lots of people ...
0
votes
1answer
492 views
GlusterFS SSL not working
I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me.
I have tried it the simple way:
openssl genrsa -out glusterfs.key ...
2
votes
1answer
71 views
Virtual Hosting Cluster File System Confusion
My title probably doesn't encompass the full scope of what I'm needing, so I'll lay out what I want to accomplish.
I have two Linux servers with large drive arrays, multiple CPUs and a large amount ...
2
votes
1answer
352 views
Why are GlusterFS replicated volumes not recommended for Hosts in different datacenters?
Any tutorial I can find about GlusterFS replicated volumes assumes that both (all) bricks are on the same private network which then also leads to the conclusion they must be in the same datacenter.
...
1
vote
0answers
442 views
How can I bind glusterfsd process to an interface (ip)?
I try to bind gluster processes to the internal (lan) interface unsuccessfully.
According to the documentation I can bind to IP in /etc/gluster/glusterd.vol
# cat /etc/glusterfs/glusterd.vol
volume ...
1
vote
1answer
325 views
Docker/Kubernetes (Minikube) boot time - mount: unknown filesystem type 'glusterfs'
I'm trying to set up a kubernetes/docker container (using Minikube) with a glusterfs volume mounted, but every time I try to start the service/pods I get "mount: unknown filesystem type 'glusterfs'" ...
0
votes
2answers
313 views
Networked In-Memory FileSystem w/ zram + XFS + GlusterFS - Best Practices
A few months ago I used XFS formatted zram devices strung together with GlusterFS to create a distributed / networked / replicated in-memory filesystem on a few bare metal servers (running RHEL 7.2).
...
1
vote
2answers
573 views
GlusterFS v3.10 not mounting on boot Centos 7.3-1611
FIXED for me at least. And I have no idea how. I've run through the logs from when it wasn't working to now when it is and I cannot for the life of my see any different. What is different and I don't ...
1
vote
1answer
237 views
SSL on management path for *unique* GlusterFS setup
Hi I have two file servers, let's call them g1 @ 10.13.13.201, and g2 @ 10.13.13.202. I've been able to successfully merge both into a glusterfs volume being mounted on 10.13.13.201:/mnt/glusterfs. So ...
4
votes
1answer
425 views
Distributed file system (e.g., glusterfs) without replication
I have a controller server, and two 24 SAS fileserver arrays. Each fileserver array is set up as a ZFS pool with 4 RAIDZ2 vdevs with 6 drives each.
Ultimately, I want to be able to use the ...
2
votes
0answers
596 views
Scale out a Gluster Disperse Volume
I've been playing with Gluster for a few hours to see if it will fit our needs and so far so good. However, I've been looking around the internet for the "how to" of expanding a dispersed volume and ...
