Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
0
votes
0answers
32 views
Ceph vs GlusterFS for elasticsearch storage
Elasticsearch will be holding logs mostly, so we expect sequential read/writes. Does anyone have experience on this? Elasticsearch will run via openshift, if it makes any difference.
0
votes
0answers
6 views
Connecting to GlusterFS servers with high availability
When setting up GlusterFS clients with Fuse, the quickstart documentation says to simply add the following to /etc/fstab:
10.0.0.1:/brick /mnt/glusterfs glusterfs defaults,_netdev 0 0
Where 10.0.0.1 ...
1
vote
1answer
99 views
Ceph or Gluster for implementing big NAS
We are planning to build NAS solution which will be primarily used via NFS and CIFS and workloads ranging from various archival application to more “real-time processing”. The NAS will not be used as ...
1
vote
1answer
38 views
Glusterfs FUSE client black magic (automatic high availability)
Quick question regarding the Glusterfs FUSE client black magic. I currently have a gluster 3 node doing a single replica volume. On my gluster fuse client i am pointing to one of the glusterfs nodes ...
1
vote
1answer
40 views
MongoDB/ElasticSearch in Kubernetes
I am exploring the Kubernetes toolset and have now my dedicated 3 nodes cluster up and running.
Next steps are migrating our company projects to the cluster. As we use MongoDB and ElasticSearch and ...
1
vote
0answers
22 views
Glusterfs dont mirror supposed mirrored folder
Gluster dont replicate mirrored content:
xfce4-terminal -T LocalTerm
exit
At LocalTerm:
PS1='[\u@\h]-[\D{%T}]-[\W] => '
lxc profile copy default default-bkp
lxc profile set default raw....
0
votes
0answers
77 views
mount problems with keepalived, glusterfs and nfs-ganesha
I installed glusterfs, keepalived (using one VIP for both servers) and nfs-ganesha on two servers.
So far, everything is working. But there is a problem when I try to mount from a third server:
When ...
0
votes
0answers
15 views
Slow gluster (auto)mount when a server is down
I have a gluster cluster formed by 3 servers : gfs1, gfs2 and gfs3 ( Type: Replicate , Number of Bricks: 1 x 3 = 3 ) .
I'm testing the usage from a 4th server.
When everything is up manual&auto ...
1
vote
4answers
113 views
Best solution for docker volume persistance [closed]
I'd like to setup proper way to persist docker volumes.
Currently all our docker volumes are local only, so in case of server failure our data are lost.
I'm thinking about buying two servers and ...
google-cloud-platform
0
votes
1answer
37 views
GlusterFS memory leak
I am using glusterfs on Kubernetes for about 7GB of storage. I have 4 nodes, two of which are holding the replica sets. One of the nodes has a constant memory leak. Starts out at about 100MB then ...
0
votes
0answers
13 views
Moving to GlusterFS from Lsync - Worths my case?
We are balancing our website traffic onto two simple LAMP servers with the help of a load balancer in front.
We are using MySQL replication for the database and Lsync daemon for syncing files.
We ...
-2
votes
1answer
130 views
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers.
Need test the solution locally before install it on prodution and even ...
0
votes
0answers
8 views
Resource requirements for glusterfs [duplicate]
We are running 2 gluster nodes in Gcloud with below specs.
Spec of one gluster node.
8 vcpus/30GB RAM. 8TB HDD with 750GB SSD used as Bcache.
Currently using Ubuntu, but we have plans of moving to ...
2
votes
1answer
38 views
Does glusterFS allow you to use multiple “classes” of storage?
I am used to traditional SANs. On a traditional SAN, we're able to create tiers of storage (fast disks, slow disks), and then allocate volumes from those tiers of storage. This way a device that needs ...
0
votes
1answer
147 views
Glusterfs brick size
I'm trying to deploy a gluster cluster with 12 nodes with 10 TB each one, but when I create the volume each brick is created with only 50GB, it must have the entire disk space i suppose. This is my ...
0
votes
1answer
63 views
glusterfs client mount point fails with 'Client quorum is not met'
Assume a basic replica 3 arbiter 1 configuration, glusterfs-server 4.0.2 and glusterfs-client 4.0.2.
glusterfs-client is installed on Ubuntu 18.04.
In order to verify that write / read ops are ...
0
votes
1answer
805 views
peer probe: failed: Probe returned with Transport endpoint is not connacted
I want to create 2 server glusterfs but I don't know why when I run command gluster peer probe server1 they have error. Firewalld is active.
# gluster peer probe server1
peer probe: fail: Probe ...
1
vote
2answers
68 views
Filesystem Test for Contended Writes
I have been using a suite of filesystem testing tools to benchmark and abuse a GlusterFS volume. The volume is a replica 3 volume spread out over 6 hosts.
Fio, iozone, and Bonnie indicate to me that ...
1
vote
2answers
148 views
Glusterfs can't set xattr security.selinux
I'm currently trying to use Gluster as storage for docker volumes on Centos 7.
The gluster version is 4.0.2.
On creation of the volume the files from the container are copied to the new volume. The ...
1
vote
1answer
51 views
Glusterfs 2x server issue
I am having almost identical issue, while so can provide more details on how the set up is:
2x server replica 2 gluster volume from two bricks. Brick
IMG-01:/images/storage/brick1 49152 ...
0
votes
1answer
257 views
Gluster and “failed to fetch volume file”
I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
0
votes
0answers
17 views
Do I need to set up quorum in a 2x replicated glusterfs servers?
I am seeing a weird issue on a 2x replicated glusterfs servers. While all the status and volume info for glusterfs shows correctly set and running and up status; writing on one server is not ...
0
votes
0answers
22 views
Can a Gluster node stay operational when completely isolated from other nodes?
I'm trying to cut down storage expences on a virtual hosting by keeping rarely used files on my own physical PC.
The main requirement: when a network problem occurs, it is ok to not be able to read ...
0
votes
1answer
185 views
Gluster snapshot directory error: Transport endpoint is not connected
When I try to access the snapshot directory for a volume, I keep getting .snaps: Transport endpoint is not connected I killed and started the glusterd service but still keep getting that error message....
1
vote
0answers
74 views
how to solve glusterfs GFID split-brain
I have a glusterfs of three servers and after a bit of troubleshooting i concluded that a file has a gfid split-brain.
**Server1**
# file: srv/glusterfs/gbrick/file1
trusted.afr.dirty=...
1
vote
2answers
185 views
Can a single gluster brick be used with multiple volumes?
I know a volume can span multiple bricks. I was wondering is the converse true where a single brick is used with multiple volumes.
Or we should just use the subdir option.
3
votes
0answers
569 views
GlusterFS peer appears disconnected in one of the peers
I have am using a GlusterFS cluster with a Trusted Storage Pool consisting out of 4 peers.
example-prod (100.100.250.197)
example-storage1 (100.100.248.178)
example-storage2 (100.100.250.25)
example-...
-1
votes
1answer
124 views
mount glusterfs before nginx start after reboot
On Centos 7 after reboot
How can I make sure NGINX is only started after the glusterFS mount is completed?
I tried adding a line to rc.local but nginx fails to start and the directory is not mounted ...
0
votes
1answer
198 views
Why does Gluster volume mount with only half capacity
Problem: A Distributed-Replicate Gluster volume only has half capacity.
I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume.
Both Gluster servers ...
0
votes
1answer
472 views
Does GlusterFS require XFS or can it work with other file systems?
I am trying to install GlusterFS and I see all the instructions utilize the creation of an XFS mount point, is it a limitation that GlusterFS requires XFS? Can it work with vfat or ntfs mounts?
1
vote
1answer
255 views
Gluster Mount via Systemd
I need to get a gluster volume to mount on boot. Placing it in /etc/fstab does not produce reliable results.
I setup the following systemd service:
[Unit]
Description=Gluster Mount
[Service]
Type=...
1
vote
0answers
382 views
Write speed of gluster volume reduced over time
I have a gluster volume with the following configuration.
~~~~~~~~~~~~~~~~~~~~~
Number of Bricks: 9
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 3 = 3
Cold Tier:...
0
votes
0answers
460 views
Glusterfs poor performance on Ovirt
We've setup an Ovirt Cluster based on Gluster filesystem.
There is 51 vms (mixed environments windows,linux,bsd and so on) on Gluster Data Domain.
At some hours of the day we saw "Disk I/O is ...
0
votes
0answers
27 views
Stop polkit from changing permission on bricks CentOS7
After a period of time all the files and directories under my bricks change to polkitd.ssh_keys
I'm not sure the 'proper' way to tell polkit to go away from my bricks, I have the user.group I need ...
0
votes
0answers
114 views
Gluster mount shows question marks for new files permissions
I have a Gluster volume mounted on two servers.
If I create a file on server a and do an ls -l on server b I see the following
-????????? ? ? ? ? ? test321.svg
The same ls on server a
-rw-r--r-- ...
0
votes
1answer
698 views
How to delete thin volumes from an overcomitted LVM thin pool
So i have a LVM thin pool (used for glusterfs with snapshots) that got overcommitted and now has metadata read-only (M attribute). There are a few snapshot lvs left on the pool (gluster created those ...
3
votes
1answer
406 views
CTDB Samba failover not highly available
TL;DR
Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection.
here and here state there is work in progress to make this possible
here states it is ...
0
votes
1answer
206 views
Can not change SELinux security context on Gluster FS folder
I can not change the security context of a folder which is created inside a Gluster-FS volume. Following is the error I keep getting.
chcon: failed to change context of ‘test’ to ‘system_u:object_r:...
4
votes
0answers
1k views
excessive glusterfs memory usage
I run a 3-node glusterfs 3.10 cluster based on Heketi to automatically provision and deprovision storage via Kubernetes. Currently, there are 20 volumes active - most with the minimum allowed size of ...
0
votes
2answers
813 views
GlusterFs - remove and Add brick is not possible
I have a GlusterFS (3.12.1) cluster of 3 nodes.
Setp 1: removed a node (node2)
from node1
# gluster volume remove-brick swarm-data replica 2 node2:/glusterfs/swarm-data force
# gluster peer ...
1
vote
1answer
293 views
Retry all failed mounts with systemd
I created several GlusterFS volumes replicated over 9 machines. All of the mounts (128 to be exact) are managed by systemd.
The systemctl command shows a random subset of the mounts as "failed" (see ...
4
votes
2answers
466 views
Identifying cause of GlusterFS data corruption
I have been experiencing data corruption when writing data to a replicated GlusterFS volume I have configured across two servers.
The configuration I have set up is as follows:
Servers are running ...
1
vote
0answers
115 views
glusterfs mkfifo permission denied
I have a glusterfs volume. I can write files to it just fine, but when I am trying to create a pipe, it gives me permission denied.
[2017-09-30 15:57:57.148455] E [MSGID: 114031] [client-rpc-fops.c:...
0
votes
0answers
224 views
Network based file system for small files ( cache files )
I'm planning on moving nginx cache to a network based storage and my main concern is choosing a network based file system that has good performance and low latency .
I've seen lots of people ...
0
votes
1answer
571 views
GlusterFS SSL not working
I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me.
I have tried it the simple way:
openssl genrsa -out glusterfs.key ...
2
votes
1answer
84 views
Virtual Hosting Cluster File System Confusion
My title probably doesn't encompass the full scope of what I'm needing, so I'll lay out what I want to accomplish.
I have two Linux servers with large drive arrays, multiple CPUs and a large amount ...
2
votes
1answer
390 views
Why are GlusterFS replicated volumes not recommended for Hosts in different datacenters?
Any tutorial I can find about GlusterFS replicated volumes assumes that both (all) bricks are on the same private network which then also leads to the conclusion they must be in the same datacenter.
...
1
vote
0answers
486 views
How can I bind glusterfsd process to an interface (ip)?
I try to bind gluster processes to the internal (lan) interface unsuccessfully.
According to the documentation I can bind to IP in /etc/gluster/glusterd.vol
# cat /etc/glusterfs/glusterd.vol
volume ...
1
vote
1answer
354 views
Docker/Kubernetes (Minikube) boot time - mount: unknown filesystem type 'glusterfs'
I'm trying to set up a kubernetes/docker container (using Minikube) with a glusterfs volume mounted, but every time I try to start the service/pods I get "mount: unknown filesystem type 'glusterfs'" ...
0
votes
2answers
333 views
Networked In-Memory FileSystem w/ zram + XFS + GlusterFS - Best Practices
A few months ago I used XFS formatted zram devices strung together with GlusterFS to create a distributed / networked / replicated in-memory filesystem on a few bare metal servers (running RHEL 7.2).
...
