GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.

learn more… | top users | synonyms

1
vote
2answers
2k views

NFS on Btrfs on multi-devices .vs. Glusterfs on distributed-volume?

I considering a storage for Email. This storage system run on my own private cloud (already replicated), then i does not care about replication. I'm thinking about 2 options: 1- I will create few "...
3
votes
3answers
474 views

Security concerns with glusterfs?

I am not really good at gluster as I just started using this yesterday. I have 2 servers. Both are running glusterfs-servers. From server 1: I run sudo glusterfs peer probe server2 and it is added ...
0
votes
0answers
6 views

Change Gluster default block size

I'm building a Gluster server, using Gluster 3.7 on top of Centos7. In the profiling report, read is always in the same 128k block size. And write can aggregate to bigger block size, thus have higher ...
3
votes
2answers
3k views

GlusterFS direct I/O mode

Could you please help me to understand 'direct-io-mode' in GlusterFS. I'm getting better read results with direct I/O mode disabled - is it mean that in disabled mode it's writing/reading from cache ...
0
votes
0answers
14 views

GlusterFS over Internet using asymmetrical connections

I am setting up a storage-network with multiple locations and planned using GlusterFS. At the moment I have some questions: Geographical location: 3 offices each office has an asymmetrical ...
-2
votes
0answers
7 views

Why does gluster require port per brick?

I am trying to find the reason why gluster needs a port for each brick. Can someone help me understand the reason or point me to some documentation for the same.
0
votes
0answers
11 views

Best topology for mirrored data servers in GlusterFS

I am currently laying out the topology for a GlusterFS cluster, which is expected to grow pretty fast. Therefore, scalability and resiliency are key in this regard. The topology I've come up with is ...
2
votes
1answer
3k views

gluster IOPS performance

Can "gluster" serve FLV files without any front-end server layers just using the built-in HTTP protocol ? How would the IOPS compare to standard apache serving? Would gluster help me with I/O limits ...
1
vote
1answer
364 views

How do you add a replacement HDD to a glusterfs volume?

I recently inherited a glusterfs setup that I know literally zero about. One of the HDD's that provides a brick to the volume failed and I was able to replace that HDD and the host OS can see the HDD. ...
16
votes
3answers
2k views

Systemd: start a unit after another unit REALLY starts

In my particular case I want to start remote-fs unit after all glusterfs completely starts. My systemd files: glusterfs target: node04:/usr/lib/systemd/system # cat glusterfsd.service [Unit] ...
0
votes
1answer
63 views

How to change directory of glusterfs brick?

I have a glusterfs brick mounted on the following dir: /home/data/bricks/brick1/brick1 Now I would like to change it to: /bricks/project/brick1 According to the manual one has to migrate ...
0
votes
0answers
27 views

GlusterFS rebalancing volume failed

We are using GlusterFS 3.7.11 for distributed/replicated volume. originally the volume was formed from 4 bricks each on one dedicated node. we added 4 nodes to our design and in order to extend the ...
0
votes
1answer
2k views

glusterfs 3.2.5 transport endpoint is not connected

I have been trying to setup a mirror across 2 servers with gluster (3.2.5) on ubuntu 12.04 for a day or so now and can't figure out what I am doing wrong. I have a openvpn tunnel between the two vps ...
0
votes
1answer
25 views

Can I do the GlusterFS setup with a LB or heartbeat service in SLES 12? If yes, How?

I've installed GlusterFS on Suse 12 with 2 VMs & 2 replica. When one server goes down it doesn't failover to the 2nd IP automatically. Can I do the same with a loadbalancer or heartbeat service? ...
2
votes
1answer
2k views

failed to fetch volume file

When my client try to connect gluster server it gives below error: [glusterfsd-mgmt.c:1627:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:gluster_vol_0) My client is an Amazon Linux ...
0
votes
0answers
15 views

Why are files listed in gluster heal info?

I have four volumes replicated on two bricks. One brick was down for about 4 hours, and when I brought it back up the self heal started. It's been two days now, and running gluster volume heal info ...
0
votes
1answer
1k views

GlusterFS How to add replica brick to system

I am trying to add two bricks to a Gluster Volume. The two new nodes are in the network, and can be verified with: root /# gluster peer status Also the volume: Status of volume: mainvolume Gluster ...
0
votes
0answers
24 views

Multiple disk sizes for best case parity in gluster

I'm currently stuck with my current situation in creating a Distributed File System. I have 2x 8TB drives 2x 4TB drives 2x 2TB drives 2x 1TB drives I've been looking into glusterfs and it seems ...
10
votes
5answers
9k views

How to monitor glusterfs volumes

Glusterfs, while being a nice distributed filesystem, provides almost no way to monitor it's integrity. Servers can come and go, bricks might get stale or fail and I afraid to know about that when it ...
0
votes
2answers
1k views

How to replicate existing files using GlusterFS

I am testing GlusterFS to replicate data across two test servers. I have followed this excellent step by step Howto and everything worked flawlessly. I have successfully added the peer, created a ...
0
votes
0answers
47 views

GlusterFS Distributed-Replicated volume performance

I'm making some tests to choose a distributed filesystem solution and now I'm focusing on GlusterFS. So I've made some test writing batches of 1000 files x 4kB to volumes mounted with glusterfs client ...
0
votes
0answers
10 views

Uploading files from a Webserver to GlusterFS?

So the question is exactly what the title suggets. If I have a dedicated server set up using GlusterFS... How would I transfer a file from the web server (that is using Nginx) to GlusterFS and more ...
0
votes
1answer
16 views

Gluster errors and corrupted permissions

Today we faced a strange error while using gluster. The gluster log was full of [2016-04-18 03:54:32.164587] W [fuse-bridge.c:462:fuse_entry_cbk] 0-glusterfs-fuse: 128: LOOKUP() /jobs/...
0
votes
0answers
30 views

Gluster for replication/propagation

Say I have a bunch of servers that access a gluster mount to serve files via http. Files are sourced internally, and are copied from an internal server to the gluster mount on one of the download ...
0
votes
1answer
2k views

GlusterFS - Replication Over Odd Numbers Of Nodes

I tried to create a replicated volume across my 3-node cluster with the following command: sudo gluster volume create \ replicatedStorage \ replica 2 \ transport tcp \ gluster1.mydomain.com:/data \ ...
0
votes
0answers
28 views

Is it safe for nginx-php-fpm servers in a pool to share config files on a GlusterFS volume?

I'm in the middle of setting up a pool of webservers using nginx with php-fpm. I'm using a glusterfs volume to hold php/html files. I've realized that keeping things like php.ini, and sites-enabled ...
2
votes
0answers
124 views

Postgresql with data on distributed file system

I am curious if somebody is actually running postgresql in production with on some form of distributed file system - glusterfs preferably, or anything. Now i have mesos/marathon running for hosting ...
1
vote
2answers
3k views

Ubuntu 12.04 glusterfs volume failed to mount at boot time

I have just setup 7 KVM guests, all running Ubuntu 12.04 LTS 64bit Minimal server to test out glusterfs 3.2.5 from the Ubuntu official repo. Two of them form a mirrored pair (i.e. replica 2), and five ...
1
vote
0answers
107 views

Speeding up GlusterFS in AWS

I needed a good NFS storage cloud in AWS, and since EFS is just in preview mode, I did some research, and GFS looked like it would be the best bet. Currently, I have two servers that are part of one ...
1
vote
2answers
1k views

Mounting GlusterFS share under www-data user

Problem: After directory is auto-mounted, Web Server has no write permissions to it. Question: How to auto-mount GlusterFS endpoint via /etc/fstab so that mount point belongs to www-data after it's ...
2
votes
1answer
208 views

How to properly configure a 2 node glusterfs system?

I am trying to make a 2 node linux servers with high available apache using glusterfs 3.7.6 for data replication and pacemaker+corosync as resource manager. However i'm seeing a problem with gluster ...
0
votes
1answer
157 views

Google Cloud Storage Fuse vs GlusterFS, pros, cons and costs

I'm setting up some web servers on Google Cloud Compute and I need a directory synced between all the servers to keep the web sites in sync. I'd also like to use the autoscaling feature to provision ...
2
votes
2answers
98 views

Using Glusterfs Dist-Replica Storage Pool for Hyper-V Virtual Machine Storage

Am chasing down some information regarding an upcoming project. So Basically we have a large Glusterfs Dist-Replica Storage pool running on ubuntu and we want to have several virtual machines running ...
1
vote
0answers
159 views

rsync crashes machine while performing sync on glusterfs mounted share

I am running ubuntu 14.04 as guest inside virtualbox 5.0.3 on OS X. While performing rsync on a glusterfs (3.7.x) mounted share with over 100.000 files, the entire machine crashes. There is one ...
0
votes
1answer
220 views

gluster libgfapi HA

I was exploring KVM_qemu with gluster distributed storage. My goal was to build a test cluster with complete HA . i.e HA for VMs as well as gluster storage . I'm planning to setup a 3 node gluster ...
3
votes
1answer
91 views

Why does Puppet (almost) always fail to write to my Gluster filesystem?

I'm using Puppet to manage some files that are shared between servers, by way of the GlusterFS file system. (The specifics shouldn't matter, but in this case things like /etc/httpd/conf.d and /var/www/...
1
vote
1answer
1k views

How to reset glusterd configuration?

Somehow I can not get glusterfs running again on ubuntu 14.04. I used to have it up and running a few days ago, including a configured volume. Then I removed the start script from autostart. Now I ...
0
votes
1answer
137 views

Gluserfs heal info shows gfid's only

I have a two-node GlusterFS setup. Each one has 2 replicates. One of the system was overloaded somehow. Then things started to go wrong. Currently I have all application shutdown. I'm short of ...
0
votes
1answer
611 views

How to automate GlusterFS backups with snapshots and dd?

I want to automate backups on a glusterfs 3.7.3 share with snapshots. Creating snapshots on a LVM manualy works, but how are they secured to a different server? I was able manage that process ...
3
votes
1answer
701 views

GlusterFS snapshot backup solution

We're looking for a fast way to take point in time snapshots of our gluster bricks. It is not crucial that it is a perfect point in time snapshot (i.e if files change/get added/removed during the ...
0
votes
1answer
54 views

Restoring brick on new server failes -

I am triying to attach a brick from another server to a local gluster development server. Therfore I have done a dd from a snapshot on production and a dd on the lvm volume on development. Then I ...
1
vote
2answers
623 views

Permission denied with Openshift PersistentStorage on GlusterFS

I'm trying to use OpenShift with PersistentStorage on a GusterFS cluster. I'm starting one of the default templates : mysql-persistent I've installed a GlusterFS cluster and create a volume ...
0
votes
0answers
94 views

glusterfs backup - how to migrate image to new server?

I am running glusterfs on a 3 node prod server with thinly provisioned LVM-Volumes. My goal is to automate a backup process that is based on gluster snapshots. The idea is basically to run a shell ...
1
vote
2answers
84 views

Clustered cron with one server only overlap allowed

I've setuped load balancers: lb1 (active) and lb2 (passive), Glustered web servers: web1 (active), web2 (backup), and some clustered database. Both web servers and databases are A pointed to the VIP ...
0
votes
0answers
115 views

Why does rebalancing glusterfs bricks fail?

I am running glusterfs on ubuntu 14.04 with 2 nodes. While trying to add a 2 bricks to the cluster I have started to rebalance the bricks. Unfortunatelly the status command tells me that it has failed:...
0
votes
0answers
12 views

Planning For Growth with GlustreFS

I'm looking into GlusterFS and want to be able to add capacity one storage node at a time. I want to mirror data on two nodes at all times, and keep maintenance simple. I also want the cluster to keep ...
1
vote
0answers
15 views

Changing files in glusterfs volume instead of using a client

I have a volume with replication factor 2 on 2 nodes. So that each brick contains its own copy of all files... Is it possible to avoid using glusterfs client and write/read to/from volume directory ...
0
votes
0answers
52 views

Glusterfs: Unable to retrieve store handle for /etc/glusterd/vols/ufiles/bricks/(null)

At some point the serer which hosts my GlusterFS volume had its / filled. Because of this, glusterd stopped working. Now when I try to restart the daemon, it gives me following error: # glusterd --...
0
votes
3answers
136 views

symlinks on shared storage

Say I have a glusterfs mount that is shared between multiple servers, which is accessed by an application, and logs are written to a directory that would normally be in the directory tree of that ...
0
votes
1answer
121 views

installing GlusterFS 3.7.5 on AWS AMI

I am trying to install Gluster 3.7.5 on Amazon Linux AMI but cannot get passed error Error: Package: glusterfs-libs-3.7.5-1.el7.x86_64 (glusterfs-epel) Requires: rsyslog-mmjsonparse Error: ...