Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
0
votes
0answers
20 views
glusterfs for wordpress hosting
I've seen many tutorials recommending glusterfs for distributed web application hosting. Is this really the best practice for small scale load balancing?
It seems the latency issue is slowing us ...
1
vote
1answer
41 views
GlusterFS: Permissions for brick
When setting up a GlusterFS what are the requirements for the brick i.e. the directory on the gluster server in terms of
permissions
ownership
I know that gluster is fully POSIX-compliant but I was ...
0
votes
1answer
32 views
Does GLusterFS / Fuse properly support mmap()?
Background
I've been having some file locking issues with running Dovecot IMAP storage on a triple-replicated Gluster Volume. The volume is mounted with the glusterfs type using defaults. This ...
2
votes
0answers
20 views
How do I use GlusterFS in a reuse scenario?
I am going to repurpose 5 servers from their previous use as computational servers to be a KVM system. This will become my sandbox for testing patches and for testing new software, configuration ...
0
votes
0answers
219 views
Unable to mount gluster fs on glusterfs client: Transport endpoint is not connected
UPDATE: Upgrade to latest version 5.2 and thus update the log. However, issue stays the same
UPDATE 2: also update client to 5.2, still the same issue.
I have a gluster cluster setup with 3 nodes.
...
0
votes
0answers
100 views
Ceph vs GlusterFS for elasticsearch storage
Elasticsearch will be holding logs mostly, so we expect sequential read/writes. Does anyone have experience on this? Elasticsearch will run via openshift, if it makes any difference.
0
votes
0answers
10 views
Connecting to GlusterFS servers with high availability
When setting up GlusterFS clients with Fuse, the quickstart documentation says to simply add the following to /etc/fstab:
10.0.0.1:/brick /mnt/glusterfs glusterfs defaults,_netdev 0 0
Where 10.0.0.1 ...
1
vote
1answer
402 views
Ceph or Gluster for implementing big NAS
We are planning to build NAS solution which will be primarily used via NFS and CIFS and workloads ranging from various archival application to more “real-time processing”. The NAS will not be used as ...
1
vote
1answer
82 views
Glusterfs FUSE client black magic (automatic high availability)
Quick question regarding the Glusterfs FUSE client black magic. I currently have a gluster 3 node doing a single replica volume. On my gluster fuse client i am pointing to one of the glusterfs nodes ...
1
vote
1answer
53 views
MongoDB/ElasticSearch in Kubernetes
I am exploring the Kubernetes toolset and have now my dedicated 3 nodes cluster up and running.
Next steps are migrating our company projects to the cluster. As we use MongoDB and ElasticSearch and ...
1
vote
0answers
26 views
Glusterfs dont mirror supposed mirrored folder
Gluster dont replicate mirrored content:
xfce4-terminal -T LocalTerm
exit
At LocalTerm:
PS1='[\u@\h]-[\D{%T}]-[\W] => '
lxc profile copy default default-bkp
lxc profile set default raw....
0
votes
0answers
22 views
Slow gluster (auto)mount when a server is down
I have a gluster cluster formed by 3 servers : gfs1, gfs2 and gfs3 ( Type: Replicate , Number of Bricks: 1 x 3 = 3 ) .
I'm testing the usage from a 4th server.
When everything is up manual&auto ...
1
vote
4answers
171 views
Best solution for docker volume persistance [closed]
I'd like to setup proper way to persist docker volumes.
Currently all our docker volumes are local only, so in case of server failure our data are lost.
I'm thinking about buying two servers and ...
google-cloud-platform
0
votes
1answer
64 views
GlusterFS memory leak
I am using glusterfs on Kubernetes for about 7GB of storage. I have 4 nodes, two of which are holding the replica sets. One of the nodes has a constant memory leak. Starts out at about 100MB then ...
0
votes
0answers
14 views
Moving to GlusterFS from Lsync - Worths my case?
We are balancing our website traffic onto two simple LAMP servers with the help of a load balancer in front.
We are using MySQL replication for the database and Lsync daemon for syncing files.
We ...
-2
votes
1answer
174 views
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers.
Need test the solution locally before install it on prodution and even ...
0
votes
0answers
8 views
Resource requirements for glusterfs [duplicate]
We are running 2 gluster nodes in Gcloud with below specs.
Spec of one gluster node.
8 vcpus/30GB RAM. 8TB HDD with 750GB SSD used as Bcache.
Currently using Ubuntu, but we have plans of moving to ...
2
votes
1answer
39 views
Does glusterFS allow you to use multiple “classes” of storage?
I am used to traditional SANs. On a traditional SAN, we're able to create tiers of storage (fast disks, slow disks), and then allocate volumes from those tiers of storage. This way a device that needs ...
0
votes
1answer
231 views
Glusterfs brick size
I'm trying to deploy a gluster cluster with 12 nodes with 10 TB each one, but when I create the volume each brick is created with only 50GB, it must have the entire disk space i suppose. This is my ...
0
votes
1answer
86 views
glusterfs client mount point fails with 'Client quorum is not met'
Assume a basic replica 3 arbiter 1 configuration, glusterfs-server 4.0.2 and glusterfs-client 4.0.2.
glusterfs-client is installed on Ubuntu 18.04.
In order to verify that write / read ops are ...
0
votes
1answer
1k views
peer probe: failed: Probe returned with Transport endpoint is not connacted
I want to create 2 server glusterfs but I don't know why when I run command gluster peer probe server1 they have error. Firewalld is active.
# gluster peer probe server1
peer probe: fail: Probe ...
1
vote
2answers
68 views
Filesystem Test for Contended Writes
I have been using a suite of filesystem testing tools to benchmark and abuse a GlusterFS volume. The volume is a replica 3 volume spread out over 6 hosts.
Fio, iozone, and Bonnie indicate to me that ...
1
vote
2answers
198 views
Glusterfs can't set xattr security.selinux
I'm currently trying to use Gluster as storage for docker volumes on Centos 7.
The gluster version is 4.0.2.
On creation of the volume the files from the container are copied to the new volume. The ...
1
vote
1answer
57 views
Glusterfs 2x server issue
I am having almost identical issue, while so can provide more details on how the set up is:
2x server replica 2 gluster volume from two bricks. Brick
IMG-01:/images/storage/brick1 49152 ...
0
votes
1answer
354 views
Gluster and “failed to fetch volume file”
I recently upgraded one of my gluster clients to a Debian stretch based system and am not able to mount any gluster volumes from it. My gluster server runs 3.4.2 on Ubuntu 14.04. The Stretch system ...
0
votes
0answers
20 views
Do I need to set up quorum in a 2x replicated glusterfs servers?
I am seeing a weird issue on a 2x replicated glusterfs servers. While all the status and volume info for glusterfs shows correctly set and running and up status; writing on one server is not ...
0
votes
0answers
26 views
Can a Gluster node stay operational when completely isolated from other nodes?
I'm trying to cut down storage expences on a virtual hosting by keeping rarely used files on my own physical PC.
The main requirement: when a network problem occurs, it is ok to not be able to read ...
0
votes
1answer
241 views
Gluster snapshot directory error: Transport endpoint is not connected
When I try to access the snapshot directory for a volume, I keep getting .snaps: Transport endpoint is not connected I killed and started the glusterd service but still keep getting that error message....
1
vote
0answers
92 views
how to solve glusterfs GFID split-brain
I have a glusterfs of three servers and after a bit of troubleshooting i concluded that a file has a gfid split-brain.
**Server1**
# file: srv/glusterfs/gbrick/file1
trusted.afr.dirty=...
1
vote
2answers
334 views
Can a single gluster brick be used with multiple volumes?
I know a volume can span multiple bricks. I was wondering is the converse true where a single brick is used with multiple volumes.
Or we should just use the subdir option.
3
votes
0answers
715 views
GlusterFS peer appears disconnected in one of the peers
I have am using a GlusterFS cluster with a Trusted Storage Pool consisting out of 4 peers.
example-prod (100.100.250.197)
example-storage1 (100.100.248.178)
example-storage2 (100.100.250.25)
example-...
-1
votes
1answer
149 views
mount glusterfs before nginx start after reboot
On Centos 7 after reboot
How can I make sure NGINX is only started after the glusterFS mount is completed?
I tried adding a line to rc.local but nginx fails to start and the directory is not mounted ...
0
votes
1answer
212 views
Why does Gluster volume mount with only half capacity
Problem: A Distributed-Replicate Gluster volume only has half capacity.
I set up AWS EC2 instances as a Gluster volume, and a third EC2 instance that mount the Gluster volume.
Both Gluster servers ...
0
votes
1answer
565 views
Does GlusterFS require XFS or can it work with other file systems?
I am trying to install GlusterFS and I see all the instructions utilize the creation of an XFS mount point, is it a limitation that GlusterFS requires XFS? Can it work with vfat or ntfs mounts?
1
vote
1answer
306 views
Gluster Mount via Systemd
I need to get a gluster volume to mount on boot. Placing it in /etc/fstab does not produce reliable results.
I setup the following systemd service:
[Unit]
Description=Gluster Mount
[Service]
Type=...
1
vote
0answers
470 views
Write speed of gluster volume reduced over time
I have a gluster volume with the following configuration.
~~~~~~~~~~~~~~~~~~~~~
Number of Bricks: 9
Transport-type: tcp
Hot Tier :
Hot Tier Type : Replicate
Number of Bricks: 1 x 3 = 3
Cold Tier:...
0
votes
0answers
525 views
Glusterfs poor performance on Ovirt
We've setup an Ovirt Cluster based on Gluster filesystem.
There is 51 vms (mixed environments windows,linux,bsd and so on) on Gluster Data Domain.
At some hours of the day we saw "Disk I/O is ...
0
votes
0answers
34 views
Stop polkit from changing permission on bricks CentOS7
After a period of time all the files and directories under my bricks change to polkitd.ssh_keys
I'm not sure the 'proper' way to tell polkit to go away from my bricks, I have the user.group I need ...
0
votes
1answer
954 views
How to delete thin volumes from an overcomitted LVM thin pool
So i have a LVM thin pool (used for glusterfs with snapshots) that got overcommitted and now has metadata read-only (M attribute). There are a few snapshot lvs left on the pool (gluster created those ...
3
votes
1answer
472 views
CTDB Samba failover not highly available
TL;DR
Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection.
here and here state there is work in progress to make this possible
here states it is ...
0
votes
1answer
240 views
Can not change SELinux security context on Gluster FS folder
I can not change the security context of a folder which is created inside a Gluster-FS volume. Following is the error I keep getting.
chcon: failed to change context of ‘test’ to ‘system_u:object_r:...
4
votes
0answers
1k views
excessive glusterfs memory usage
I run a 3-node glusterfs 3.10 cluster based on Heketi to automatically provision and deprovision storage via Kubernetes. Currently, there are 20 volumes active - most with the minimum allowed size of ...
0
votes
2answers
1k views
GlusterFs - remove and Add brick is not possible
I have a GlusterFS (3.12.1) cluster of 3 nodes.
Setp 1: removed a node (node2)
from node1
# gluster volume remove-brick swarm-data replica 2 node2:/glusterfs/swarm-data force
# gluster peer ...
1
vote
1answer
326 views
Retry all failed mounts with systemd
I created several GlusterFS volumes replicated over 9 machines. All of the mounts (128 to be exact) are managed by systemd.
The systemctl command shows a random subset of the mounts as "failed" (see ...
4
votes
2answers
573 views
Identifying cause of GlusterFS data corruption
I have been experiencing data corruption when writing data to a replicated GlusterFS volume I have configured across two servers.
The configuration I have set up is as follows:
Servers are running ...
1
vote
0answers
142 views
glusterfs mkfifo permission denied
I have a glusterfs volume. I can write files to it just fine, but when I am trying to create a pipe, it gives me permission denied.
[2017-09-30 15:57:57.148455] E [MSGID: 114031] [client-rpc-fops.c:...
0
votes
0answers
242 views
Network based file system for small files ( cache files )
I'm planning on moving nginx cache to a network based storage and my main concern is choosing a network based file system that has good performance and low latency .
I've seen lots of people ...
0
votes
1answer
665 views
GlusterFS SSL not working
I have been trying for hours to get GlusterFS SSL workong on the management and I/O path to no avail, so I hope you can help me.
I have tried it the simple way:
openssl genrsa -out glusterfs.key ...
2
votes
1answer
96 views
Virtual Hosting Cluster File System Confusion
My title probably doesn't encompass the full scope of what I'm needing, so I'll lay out what I want to accomplish.
I have two Linux servers with large drive arrays, multiple CPUs and a large amount ...
2
votes
1answer
441 views
Why are GlusterFS replicated volumes not recommended for Hosts in different datacenters?
Any tutorial I can find about GlusterFS replicated volumes assumes that both (all) bricks are on the same private network which then also leads to the conclusion they must be in the same datacenter.
...
