Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [glusterfs]

GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.

1
vote
0answers
11 views

Glusterfs dont mirror supposed mirrored folder

Gluster dont replicate mirrored content: xfce4-terminal -T LocalTerm exit At LocalTerm: PS1='[\u@\h]-[\D{%T}]-[\W] => ' lxc profile copy default default-bkp lxc profile set default raw....
-1
votes
0answers
11 views

Drupal HA infrastructure

What is the best way to create a Drupal high availability infrastructure? I'm thinking this infrastructure: 2 frontEnd load balanced: apache/nginx, php-fpm, glusterfs, drupal 3 backend: galera ...
0
votes
0answers
16 views

mount problems with keepalived, glusterfs and nfs-ganesha

I installed glusterfs, keepalived (using one VIP for both servers) and nfs-ganesha on two servers. So far, everything is working. But there is a problem when I try to mount from a third server: When ...
0
votes
0answers
11 views

Slow gluster (auto)mount when a server is down

I have a gluster cluster formed by 3 servers : gfs1, gfs2 and gfs3 ( Type: Replicate , Number of Bricks: 1 x 3 = 3 ) . I'm testing the usage from a 4th server. When everything is up manual&auto ...
1
vote
4answers
87 views

Best solution for docker volume persistance [closed]

I'd like to setup proper way to persist docker volumes. Currently all our docker volumes are local only, so in case of server failure our data are lost. I'm thinking about buying two servers and ...
0
votes
1answer
23 views

GlusterFS memory leak

I am using glusterfs on Kubernetes for about 7GB of storage. I have 4 nodes, two of which are holding the replica sets. One of the nodes has a constant memory leak. Starts out at about 100MB then ...
0
votes
0answers
10 views

Moving to GlusterFS from Lsync - Worths my case?

We are balancing our website traffic onto two simple LAMP servers with the help of a load balancer in front. We are using MySQL replication for the database and Lsync daemon for syncing files. We ...
-2
votes
1answer
99 views

Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers

Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers. Need test the solution locally before install it on prodution and even ...
0
votes
0answers
8 views

Resource requirements for glusterfs [duplicate]

We are running 2 gluster nodes in Gcloud with below specs. Spec of one gluster node. 8 vcpus/30GB RAM. 8TB HDD with 750GB SSD used as Bcache. Currently using Ubuntu, but we have plans of moving to ...
2
votes
1answer
36 views

Does glusterFS allow you to use multiple “classes” of storage?

I am used to traditional SANs. On a traditional SAN, we're able to create tiers of storage (fast disks, slow disks), and then allocate volumes from those tiers of storage. This way a device that needs ...
0
votes
1answer
82 views

Glusterfs brick size

I'm trying to deploy a gluster cluster with 12 nodes with 10 TB each one, but when I create the volume each brick is created with only 50GB, it must have the entire disk space i suppose. This is my ...
0
votes
1answer
42 views

glusterfs client mount point fails with 'Client quorum is not met'

Assume a basic replica 3 arbiter 1 configuration, glusterfs-server 4.0.2 and glusterfs-client 4.0.2. glusterfs-client is installed on Ubuntu 18.04. In order to verify that write / read ops are ...
0
votes
1answer
535 views

peer probe: failed: Probe returned with Transport endpoint is not connacted

I want to create 2 server glusterfs but I don't know why when I run command gluster peer probe server1 they have error. Firewalld is active. # gluster peer probe server1 peer probe: fail: Probe ...
1
vote
2answers
67 views

Filesystem Test for Contended Writes

I have been using a suite of filesystem testing tools to benchmark and abuse a GlusterFS volume. The volume is a replica 3 volume spread out over 6 hosts. Fio, iozone, and Bonnie indicate to me that ...
1
vote
2answers
112 views

Glusterfs can't set xattr security.selinux

I'm currently trying to use Gluster as storage for docker volumes on Centos 7. The gluster version is 4.0.2. On creation of the volume the files from the container are copied to the new volume. The ...
1
vote
1answer
50 views

Glusterfs 2x server issue

I am having almost identical issue, while so can provide more details on how the set up is: 2x server replica 2 gluster volume from two bricks. Brick IMG-01:/images/storage/brick1 49152 ...
0
votes
1answer
203 views

Gluster and “failed to fetch volume file”

I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
0
votes
0answers
16 views

Do I need to set up quorum in a 2x replicated glusterfs servers?

I am seeing a weird issue on a 2x replicated glusterfs servers. While all the status and volume info for glusterfs shows correctly set and running and up status; writing on one server is not ...
0
votes
0answers
20 views

Can a Gluster node stay operational when completely isolated from other nodes?

I'm trying to cut down storage expences on a virtual hosting by keeping rarely used files on my own physical PC. The main requirement: when a network problem occurs, it is ok to not be able to read ...
0
votes
1answer
131 views

Gluster snapshot directory error: Transport endpoint is not connected

When I try to access the snapshot directory for a volume, I keep getting .snaps: Transport endpoint is not connected I killed and started the glusterd service but still keep getting that error message....
1
vote
0answers
44 views

how to solve glusterfs GFID split-brain

I have a glusterfs of three servers and after a bit of troubleshooting i concluded that a file has a gfid split-brain. **Server1** # file: srv/glusterfs/gbrick/file1 trusted.afr.dirty=...
1
vote
2answers
123 views

Can a single gluster brick be used with multiple volumes?

I know a volume can span multiple bricks. I was wondering is the converse true where a single brick is used with multiple volumes. Or we should just use the subdir option.
3
votes
0answers
439 views

GlusterFS peer appears disconnected in one of the peers

I have am using a GlusterFS cluster with a Trusted Storage Pool consisting out of 4 peers. example-prod (100.100.250.197) example-storage1 (100.100.248.178) example-storage2 (100.100.250.25) example-...
-1
votes
1answer
102 views

mount glusterfs before nginx start after reboot

On Centos 7 after reboot How can I make sure NGINX is only started after the glusterFS mount is completed? I tried adding a line to rc.local but nginx fails to start and the directory is not mounted ...
0
votes
1answer
184 views

Why does Gluster volume mount with only half capacity

Problem: A Distributed-Replicate Gluster volume only has half capacity. I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume. Both Gluster servers ...
0
votes
1answer
395 views

Does GlusterFS require XFS or can it work with other file systems?

I am trying to install GlusterFS and I see all the instructions utilize the creation of an XFS mount point, is it a limitation that GlusterFS requires XFS? Can it work with vfat or ntfs mounts?
1
vote
1answer
217 views

Gluster Mount via Systemd

I need to get a gluster volume to mount on boot. Placing it in /etc/fstab does not produce reliable results. I setup the following systemd service: [Unit] Description=Gluster Mount [Service] Type=...
1
vote
0answers
313 views

Write speed of gluster volume reduced over time

I have a gluster volume with the following configuration. ~~~~~~~~~~~~~~~~~~~~~ Number of Bricks: 9 Transport-type: tcp Hot Tier : Hot Tier Type : Replicate Number of Bricks: 1 x 3 = 3 Cold Tier:...
0
votes
0answers
416 views

Glusterfs poor performance on Ovirt

We've setup an Ovirt Cluster based on Gluster filesystem. There is 51 vms (mixed environments windows,linux,bsd and so on) on Gluster Data Domain. At some hours of the day we saw "Disk I/O is ...
0
votes
0answers
23 views

Stop polkit from changing permission on bricks CentOS7

After a period of time all the files and directories under my bricks change to polkitd.ssh_keys I'm not sure the 'proper' way to tell polkit to go away from my bricks, I have the user.group I need ...
0
votes
0answers
102 views

Gluster mount shows question marks for new files permissions

I have a Gluster volume mounted on two servers. If I create a file on server a and do an ls -l on server b I see the following -????????? ? ? ? ? ? test321.svg The same ls on server a -rw-r--r-- ...
0
votes
1answer
555 views

How to delete thin volumes from an overcomitted LVM thin pool

So i have a LVM thin pool (used for glusterfs with snapshots) that got overcommitted and now has metadata read-only (M attribute). There are a few snapshot lvs left on the pool (gluster created those ...
3
votes
0answers
355 views

CTDB Samba failover not highly available

TL;DR Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection. here and here state there is work in progress to make this possible here states it is ...
0
votes
1answer
179 views

Can not change SELinux security context on Gluster FS folder

I can not change the security context of a folder which is created inside a Gluster-FS volume. Following is the error I keep getting. chcon: failed to change context of ‘test’ to ‘system_u:object_r:...
4
votes
0answers
1k views

excessive glusterfs memory usage

I run a 3-node glusterfs 3.10 cluster based on Heketi to automatically provision and deprovision storage via Kubernetes. Currently, there are 20 volumes active - most with the minimum allowed size of ...
0
votes
2answers
664 views

GlusterFs - remove and Add brick is not possible

I have a GlusterFS (3.12.1) cluster of 3 nodes. Setp 1: removed a node (node2) from node1 # gluster volume remove-brick swarm-data replica 2 node2:/glusterfs/swarm-data force # gluster peer ...
1
vote
1answer
263 views

Retry all failed mounts with systemd

I created several GlusterFS volumes replicated over 9 machines. All of the mounts (128 to be exact) are managed by systemd. The systemctl command shows a random subset of the mounts as "failed" (see ...
4
votes
2answers
392 views

Identifying cause of GlusterFS data corruption

I have been experiencing data corruption when writing data to a replicated GlusterFS volume I have configured across two servers. The configuration I have set up is as follows: Servers are running ...
1
vote
0answers
100 views

glusterfs mkfifo permission denied

I have a glusterfs volume. I can write files to it just fine, but when I am trying to create a pipe, it gives me permission denied. [2017-09-30 15:57:57.148455] E [MSGID: 114031] [client-rpc-fops.c:...
0
votes
0answers
210 views

Network based file system for small files ( cache files )

I'm planning on moving nginx cache to a network based storage and my main concern is choosing a network based file system that has good performance and low latency . I've seen lots of people ...
0
votes
1answer
492 views

GlusterFS SSL not working

I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me. I have tried it the simple way: openssl genrsa -out glusterfs.key ...
2
votes
1answer
71 views

Virtual Hosting Cluster File System Confusion

My title probably doesn't encompass the full scope of what I'm needing, so I'll lay out what I want to accomplish. I have two Linux servers with large drive arrays, multiple CPUs and a large amount ...
2
votes
1answer
352 views

Why are GlusterFS replicated volumes not recommended for Hosts in different datacenters?

Any tutorial I can find about GlusterFS replicated volumes assumes that both (all) bricks are on the same private network which then also leads to the conclusion they must be in the same datacenter. ...
1
vote
0answers
442 views

How can I bind glusterfsd process to an interface (ip)?

I try to bind gluster processes to the internal (lan) interface unsuccessfully. According to the documentation I can bind to IP in /etc/gluster/glusterd.vol # cat /etc/glusterfs/glusterd.vol volume ...
1
vote
1answer
325 views

Docker/Kubernetes (Minikube) boot time - mount: unknown filesystem type 'glusterfs'

I'm trying to set up a kubernetes/docker container (using Minikube) with a glusterfs volume mounted, but every time I try to start the service/pods I get "mount: unknown filesystem type 'glusterfs'" ...
0
votes
2answers
313 views

Networked In-Memory FileSystem w/ zram + XFS + GlusterFS - Best Practices

A few months ago I used XFS formatted zram devices strung together with GlusterFS to create a distributed / networked / replicated in-memory filesystem on a few bare metal servers (running RHEL 7.2). ...
1
vote
2answers
573 views

GlusterFS v3.10 not mounting on boot Centos 7.3-1611

FIXED for me at least. And I have no idea how. I've run through the logs from when it wasn't working to now when it is and I cannot for the life of my see any different. What is different and I don't ...
1
vote
1answer
237 views

SSL on management path for *unique* GlusterFS setup

Hi I have two file servers, let's call them g1 @ 10.13.13.201, and g2 @ 10.13.13.202. I've been able to successfully merge both into a glusterfs volume being mounted on 10.13.13.201:/mnt/glusterfs. So ...
4
votes
1answer
425 views

Distributed file system (e.g., glusterfs) without replication

I have a controller server, and two 24 SAS fileserver arrays. Each fileserver array is set up as a ZFS pool with 4 RAIDZ2 vdevs with 6 drives each. Ultimately, I want to be able to use the ...
2
votes
0answers
596 views

Scale out a Gluster Disperse Volume

I've been playing with Gluster for a few hours to see if it will fit our needs and so far so good. However, I've been looking around the internet for the "how to" of expanding a dispersed volume and ...