Questions tagged [glusterfs]
GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.
306
questions
0
votes
0answers
12 views
Glusterfs unsynced entries that are not being changed
Having glusterfs replicated volume with many many many small files (almost 1 milion).
The filesystem is accessed only via glusterfs fuse mount, mounted with 'noatime' option.
So theoretically when a ...
0
votes
0answers
10 views
Gluster 3.5 Self Heal Failing
My host had some network glitches, and now I have a gluster mess on my heads. I have a couple hundred of these and no idea how to easily and effectively track them down to correct them.
I'm running ...
0
votes
0answers
14 views
how to have atleast 2 node failure in glusterFS? with 4 nodes or 6 or 5 nodes?
how to have atleast 2 node failure in glusterFS? i had 3 node cluster with replica, but when i took down 2 nodes , then mount point failed to work. i added another node to glusterFS (4 nodes, 1x4=4 ...
0
votes
0answers
12 views
glusterfs volume offline after reboot in centos
what is difference b/w glusterd and glusterfsd. Which one should be started at boot time? And what is the proper way of starting them after reboot? The gluster volume seem to be offline after reboot. ...
0
votes
0answers
24 views
Access/manipulate/restore files in GlusterFS managed via Heketi
I would like to restore a file system backup from a postgres database.
With docker-compose I would simply set the command: tail -f /dev/null and use docker cp to put the files in place. Or even ...
0
votes
0answers
11 views
Can´t get GlusterFS unix Socket working with libvirt
I playing around to build an HA KVM-Cluster on CentOS 7.7. I build a 3 node setup and installed GlusterFS. The Glusterfs is working properly if i use the TCP protocol. But if i try to switch to unix ...
2
votes
1answer
80 views
How should I recover from Ovirt and GlusterFS partial failure?
I am managing a 3 node Ovirt 4.3.7 cluster with a hosted engine appliance; the nodes are also glusterfs nodes. The systems are:
ovirt1 (node at 192.168.40.193)
ovirt2 (node at 192.168.40.194)
ovirt3 (...
0
votes
0answers
44 views
Samsung NVMe disappears when server on average to high load
Hello to the community!
Let me get into the details of the problem itself.
We have a total of 6 SuperMicro Servers in a cluster. The problem occurs only in 3 them, which are the newest generation.
...
0
votes
0answers
87 views
Glusterfs: local .automount in fstab not working at restart
I'm using glusterfs Version 7 /debian 10 and i will try to automount my gluster volume at startup / rebooting.
Ive just tried to add this in my /etc/fstab:
127.0.0.1:/www /var/www glusterfs ...
0
votes
0answers
7 views
Can not write file to 2x2 glusterfs even though there is enough free space
Bick1 and Brick3 are on the same node. Brick1 has about 2% free space left, not enough for my file. Brick3 is about 85% free.
When I try and copy my file into my gluster mount it just fails and lets ...
0
votes
2answers
109 views
CTDB Samba script failing to start
Here is the output from a tail -f /var/log/ctdb/log.ctdb
2020/01/27 18:52:52.317670 ctdbd[3330]: Running the "startup" event.
2020/01/27 18:53:22.323208 ctdbd[3330]: startup event failed
2020/01/27 ...
1
vote
1answer
83 views
GlusterFS Volume Creation Suggestion
I have to deploy multiple Openshift Clusters from 3 nodes to 10 nodes. For 3 nodes i am creating volumes as replicated.
But for 4 and above it doesn't look nice to create replicated volume, so each ...
0
votes
0answers
69 views
MySQL - [Note] Got an error reading communication packets
I have deployed MySQL on OpenShift (kubernetes) with GlusterFS as persistent storage and i am getting following error continuously in MySQL Container logs
2020-01-17T18:00:04.787586Z 1541 [Note] Got ...
0
votes
0answers
93 views
HAProxy + Dovecot + Gluster
I'm looking to setup 2 dovecot servers behind HAProxy using gluster for a high-availability solution. From the reading I've been doing, it seems that dovecot highly suggests the use of the dovecot ...
1
vote
0answers
29 views
Can i mount a glusterfs cluster with fuse across WAN?
So ive got gluster up for our dev environment, great. We've set up tls for encryption & client authentication. Is it now possible to mount clients using fuse across WAN using the same
mount -t ...
0
votes
0answers
295 views
Glusterfs - Clients randomly disconnect until volume is restarted
Ubuntu 18.04
Glusterfs-7.0
I have created a volume for my file share and started it:
sudo gluster volume create NAME replica 3 transport tcp host0:/path0 host1:/path1 host2:/path2
sudo gluster ...
0
votes
0answers
68 views
Gluster configuration with JBOD
I have 2 of Dell MD3060e, which each includes 60 of 10TB 7.2k NLSAS. The JBODs are connected to a server via Dell SAS 12G HBA (based on LSI 9300-8e, non-raid).
We used mixture of software raid6 or ...
1
vote
1answer
246 views
K3S arm64 distributed files systems
I deployed a K3S Cluster on arm64 and I need to have a DFS directly on-premise, It will be better to have it running on the kubernetes stack.
Regarding DFS choices there are some options, but...:
...
0
votes
0answers
34 views
glusterfs recognize existing data
I have an existing Ubuntu 18 file server using ZFS. We have purchased an additional Ubuntu 18 file server. We'd like to put them both on a Glusterfs mirrored volume.
However, using test servers, I ...
0
votes
0answers
39 views
Should I use GlusterFS for mail server?
I'm planing to use GlusterFS for my mail server. But I read that GlusterFS have problems with small file ( and mail are small files). What's the problems with GlusterFS when come to working with small ...
0
votes
1answer
29 views
How to test and evaluate performent of a storage system? Compare between NFS and GlusterFS?
I have an exercise at school about the title question,I have google search for couple of hours but I'm not found anythings useful.
I only know that when come to HA, GlusterFS remove the single point ...
0
votes
0answers
33 views
Is it possible to have glusterfs arbitrated replicated folume with replica > 3?
I'm trying to build replicated volume on glusterfs for the purpose of replication between data centers. One brick for each data center. This requires 100% of the data to be existing on each brick (...
0
votes
0answers
14 views
GlusterFS Dynamic Replication With Different Brick Count
What I want to be able to do:
Have a volume with replication 3, but have 4 or 5 bricks (basically brick count be irrelevant).
What happens:
Gluster requires the number of bricks to be a multiple ...
1
vote
1answer
304 views
GlusterFS or Ceph RBD for storing Virtual Machine image
I am using glusterfs 5.3 for storing images of virtual machines in Cloudstack/KVM environment, majority of VMs are DB Servers (Sql Server & MariaDB). But I am facing performance issue on VMs ...
2
votes
0answers
359 views
Previously mountable GlusterFS volume now fails to mount with several errors
I've previously set up a couple of GlusterFS volumes (called cyclorana0 and cyclorana1) across two nodes (with IPs 10.0.2.4 (hostname alboguttata) and 10.0.2.5 (hostname verrucosa)) on my LAN. The ...
0
votes
0answers
60 views
GlusterFS multiple bricks replicating on single node
The situation at hand is I have a 4x2tb raid (1 brick), which i'm going to backup to a external usb enclosure (1 brick). I am hoping that GlusterFS will allow me to replicate the main brick on my raid ...
0
votes
0answers
53 views
GlusterFS Client mount with arbiter bricks
Considering I have an arbitrated replicated volume, just like the one here (i.e., 2 groups of 3 nodes each = 6 nodes, with 1 arbiter in each group), which hosts should the client mount include in the ...
0
votes
1answer
362 views
Chossing between GlusterFS replica 2 or 3
I can't figure out the relation between the number of bricks and replica count.
I have 4 server nodes and after running the command to create a distributed replicated volume, with a replica count of ...
0
votes
0answers
30 views
What could cause a mount to suddenly unmount?
I have been running glusterfs 3.4 in AWS for a couple months now, over the past month the glusterfs mount has disappeared from the gluster client server.
Stats from the client server seem normal,
...
2
votes
1answer
364 views
GlusterFS not running on correct port! (peer disconnected / brick not starting)
On CentOS 7 witch two bricks on srv1 and srv2
I've upgraded gluster from 313 to 6 by using yum. I then rebooted server 1, started and mounted the drive successfully.
This is my mount command:
/usr/...
0
votes
1answer
59 views
K8S: securing GlusterFS
I have a question on how to divide access to the same gluster for different K8S namespaces. Let's say, I have 3 different volumes (vol-a, vol-b, vol-c) in a gluster and I'd like to permit access to ...
1
vote
0answers
61 views
Glusterfs support for user namespaces
I have a gluster volume mounted on a host machine and tried to run a namespaced docker container with a bind mount from the gluster mount on the host.
It seems that the user namespacing is not ...
2
votes
0answers
23 views
Is it possible to recover a previously used brick in the same volume? Is it better to reuse it or clear and add as new?
Was testing how glusterfs behaves after an HDD crash and came to this issue where a previously used but not corrupted brick cannot be added back to a volume because glusterfs thinks it already is part ...
0
votes
1answer
295 views
Can't enable NFS on two-node Ansible provisioned GlusterFS cluster
I have two nodes (running Armbian Bionic, based on Ubuntu 18.04) set up to create a distributed Gluster storage, provisioned via Ansible.
I think the relevant part of the Ansible playbook is this:
...
1
vote
0answers
167 views
Increasing size of .glusterfs directory
I'm using glusterfs 3.3 version.
One of my mounted drive (15TB) is show full. After checking, I got that there is a directory .glusterfs which is uses 3TB.
I don't know the actual reason of .glusterfs ...
1
vote
0answers
66 views
GlusterFS for simple replication of existing dirs on ext4 FS?
I have an already existing CentOS 6.9 system with an already existing EXT4 filesystem (/data) housing our application. Certain directories within this file system contain critical per-transaction xml ...
0
votes
1answer
217 views
glusterfsd Ubuntu 18.04 high iowait issues
We're running gluster on two hypervisors running Ubuntu. When we upgraded from Ubuntu 14.04 to 18.04, it upgraded gluster from 3.4.2 to 3.13.2. As soon as we upgraded and since then, we've been seeing ...
1
vote
0answers
88 views
glusterfs for wordpress hosting
I've seen many tutorials recommending glusterfs for distributed web application hosting. Is this really the best practice for small scale load balancing?
It seems the latency issue is slowing us ...
2
votes
1answer
326 views
GlusterFS: Permissions for brick
When setting up a GlusterFS what are the requirements for the brick i.e. the directory on the gluster server in terms of
permissions
ownership
I know that gluster is fully POSIX-compliant but I was ...
0
votes
1answer
395 views
Does GLusterFS / Fuse properly support mmap()?
Background
I've been having some file locking issues with running Dovecot IMAP storage on a triple-replicated Gluster Volume. The volume is mounted with the glusterfs type using defaults. This ...
2
votes
0answers
31 views
How do I use GlusterFS in a reuse scenario?
I am going to repurpose 5 servers from their previous use as computational servers to be a KVM system. This will become my sandbox for testing patches and for testing new software, configuration ...
0
votes
0answers
2k views
Unable to mount gluster fs on glusterfs client: Transport endpoint is not connected
UPDATE: Upgrade to latest version 5.2 and thus update the log. However, issue stays the same
UPDATE 2: also update client to 5.2, still the same issue.
I have a gluster cluster setup with 3 nodes.
...
2
votes
1answer
2k views
Ceph or Gluster for implementing big NAS
We are planning to build NAS solution which will be primarily used via NFS and CIFS and workloads ranging from various archival application to more “real-time processing”. The NAS will not be used as ...
1
vote
1answer
378 views
Glusterfs FUSE client black magic (automatic high availability)
Quick question regarding the Glusterfs FUSE client black magic. I currently have a gluster 3 node doing a single replica volume. On my gluster fuse client i am pointing to one of the glusterfs nodes ...
1
vote
2answers
259 views
MongoDB/ElasticSearch in Kubernetes
I am exploring the Kubernetes toolset and have now my dedicated 3 nodes cluster up and running.
Next steps are migrating our company projects to the cluster. As we use MongoDB and ElasticSearch and ...
1
vote
0answers
46 views
Glusterfs dont mirror supposed mirrored folder
Gluster dont replicate mirrored content:
xfce4-terminal -T LocalTerm
exit
At LocalTerm:
PS1='[\u@\h]-[\D{%T}]-[\W] => '
lxc profile copy default default-bkp
lxc profile set default raw....
1
vote
4answers
801 views
Best solution for docker volume persistance [closed]
I'd like to setup proper way to persist docker volumes.
Currently all our docker volumes are local only, so in case of server failure our data are lost.
I'm thinking about buying two servers and ...
google-cloud-platform
0
votes
1answer
175 views
GlusterFS memory leak
I am using glusterfs on Kubernetes for about 7GB of storage. I have 4 nodes, two of which are holding the replica sets. One of the nodes has a constant memory leak. Starts out at about 100MB then ...
-2
votes
1answer
511 views
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers
Even with root user Im receiving 'Operation not permitted' when try creating gluster volume between Ubuntu 14.04 LXC containers.
Need test the solution locally before install it on prodution and even ...
2
votes
1answer
81 views
Does glusterFS allow you to use multiple “classes” of storage?
I am used to traditional SANs. On a traditional SAN, we're able to create tiers of storage (fast disks, slow disks), and then allocate volumes from those tiers of storage. This way a device that needs ...
