GlusterFS is a scale-out NAS file system that runs over Ethernet or Infiniband RDMA interconnect. GlusterFS is now owned by Red Hat.

learn more… | top users | synonyms

5
votes
2answers
766 views

HW/SW Design: 2 Petabyte of storage

Disclaimer Yes I'm asking you to design a system for me :) I'm tasked to design a system to store about 10 TB / day with a retention time of 180 days. My first approach would be to go with GlusterFS ...
1
vote
1answer
1k views

GlusterFS vs Mogile vs Others?

I have been looking at GlusterFS and MogileFS (Ceph and BTRFS are off the cards for me, as they don't seem production ready yet). I am developing a web app for file sharing, that will store and ...
3
votes
1answer
1k views

GlusterFS vs Ceph, which is better for production use in 2012? [closed]

This is the same question that was asked here, but it's been almost two years since. Meanwhile Ceph has seen constant development (361 kernel commits) and btrfs, in my opinion, is on the verge of ...
3
votes
1answer
499 views

glusterfs and dovecot problems

Ive got two servers with a shared glusterfs disk, both running dovecot and serving mail from this shared disk. Users read mail only from one of these servers but mail gets delivered to both. ...
2
votes
3answers
2k views

Amazon AutoScaling and GlusterFS

I have setup Elastic load balancing with 5 EC2 instance registered with the load balancer. To our website users upload their data(images), we store these images in network attached storage (NAS). We ...
0
votes
4answers
427 views

redundancy scalability cluster software suporting nginx? [closed]

I'm having some problems with a filesharing storage configuration that we recently set-up. We moved onto a NAS (1x24TB) recently for our video streaming service. We set-up 9 front end servers that ...
0
votes
0answers
450 views

Glusterfs for mirrorring Postfix directories

I am trying to create a mail server setup with 1 main server and 1 or more mirrored slave servers. I mounted /var/vmail as glusterfs with data (in gluster terms posix storage) in /data/export. This ...
2
votes
2answers
214 views

Hypervisor and GlusterFS (or similar) on same physical host?

I've inherited a bunch of hardware from a failed project. They're SuperMicro 2U servers with 24x SATA HDD or SSDs. I've been tasked with turning this rack of generic hardware into a IaaS cluster. I'm ...
4
votes
1answer
1k views

Can someone explain this GlusterFS setup?

After digging around to understand how to setup replication using gluster I've come across this question: Can Apache Read The GlusterFS Brick Directly But Write To The GlusterFS Mount? I've also ...
7
votes
4answers
5k views

What exactly does Gluster do?

I've been playing with gluster for the last 2 days and been asking questions here and on their questions system. I really don't understand some of the stuff. I see people saying stuff like Set up ...
2
votes
4answers
503 views

Solution for two-way file-system transparent solution

I need to implement some sort of HA setup where 2 servers need to be able to always be in sync, no matter on which one you write on. The DB part can be covered by a master-master replication setup. ...
8
votes
4answers
4k views

How to monitor glusterfs volumes

Glusterfs, while being a nice distributed filesystem, provides almost no way to monitor it's integrity. Servers can come and go, bricks might get stale or fail and I afraid to know about that when it ...
4
votes
2answers
473 views

Filesystem redundancy + speed

Looking for some input and if anyone has conquered this problem with a solution they feel confident about. Looking to setup a fault tolerant web environment. So the setup is a few nodes behind a ...
1
vote
1answer
490 views

GlusterFS as elastic file storage?

Is there any way to run GlusterFS in a replicated mode, but with the ability to dynamically scale the volume up and down? Say you have 3 servers all running glusterd. your Gluster volume would have ...
1
vote
1answer
352 views

OpenX Cluster Rsync vs Coud File System?

I am working on putting together a cluster for openx and had a question with regard to clustered file systems vs rsync. Here is my current setup: -2 workhorse boxes load balanced to serve and count ...
0
votes
2answers
2k views

How do GlusterFS permissions work on Linux?

I'm putting together a horizontally scaled Apache/GluserFS setup. I'm trying to figure out how Gluster deals with permissions. I'm going to have several hosts reading and writing to the Gluster File ...
5
votes
3answers
773 views

Need suggestions for a R/W distributed file system for a webserver cluster running Apache+PHP

In the last few months, I've been trying to find the best way to share the content of multiple websites across multiple web servers (12+) all running Apache+PHP. One of the biggest challenge I face is ...
1
vote
2answers
312 views

How do cluster file systems avoid race conditions?

How do cluster file systems avoid the myriad of possible race conditions? I'm trying to get a grip on using a cluster file system in a Master-Master architecture. I'm thinking specifically about ...
3
votes
1answer
593 views

Can you create a glusterfs with existing data in a directory?

I'm looking into convert a single server/comp into the start of a glusterfs distributed system. I already have a directory mounted on this server of 24TB RAID. I want to use this initial computer to ...
0
votes
2answers
1k views

Should I use GlusterFS as storage pool for KVM/Xen virtual machines?

Do you think that KVM (or XEN) virtual machine using GlusterFS as storage will be really slow? My idea is to use GlusterFS to avoid the limits of the local file system. If an hypervisor will go down, ...
4
votes
5answers
3k views

Experience with MooseFS? [closed]

Anyone have any experience using MooseFS? I want an easy distributed storage platform to store static data archive of about 10 TB and serve it to 20-40 nodes. Also I want to be able to add storage ...
1
vote
2answers
418 views

Write but not delete

We are using glusterfs for our cloud storage needs. Since the partition is open to many servers, we would like to disable file deletion as we don't delete or overwrite any file. Glusterfs does not ...
4
votes
1answer
1k views

GlusterFS with CIFS, quotas and LDAP

Has anyone had experience plugging GlusterFS and Openfiler together or something similar? Here is the motivation: Disk space on multiple server regrouped using GlusterFS Centralized access using ...
1
vote
1answer
362 views

Building for web node redundancy with load balancing on EC2

Currently we have on c1.medium webnode and an Amazon RDS sql server. The problem we face is that every now and then the webnode fails and the site goes down. I am considering mitigating this risk by ...
4
votes
4answers
487 views

Medium office fileserver: One professional server or multiple cheaper servers in cluster?

What would you recommend for a medium office fileserver? By medium office I mean roughly 100-150 users that connect to the fileserver sporadically during the day. We're talking about 2TB of data and ...
2
votes
3answers
4k views

recommend storage platform: Gluster Vs Nexenta

there is a new release version 3.0: http://www.gluster.com/community/documentation/index.php/Gluster_Storage_Platform has anyone tried this for VM storage? how does this compare to any ZFS based ...
1
vote
1answer
2k views

Clearer understanding for glusterfs for replication

On server01 I have installed and configured glusterfs-server and glusterfs-client to replicate directory /var/appdata to server02. It seems that anything works fine, but I'm not sure that I ...
3
votes
3answers
4k views

Can I run mysqld on top of glusterfs?

I have been playing with glusterfs recently. What I want to try is to run mysqld on top of the glusterfs in a similar way as it is possible to run MySQL on top of DRBD. I am familiar with MySQL ...
3
votes
1answer
2k views

Can Apache Read The GlusterFS Brick Directly But Write To The GlusterFS Mount?

I currently have 2 web servers (CentOS 5.5) and am using GlusterFS as client/server on both using Automatic File Replication. For both webservers: The GlusterFS mount point is: ...
2
votes
3answers
4k views

Using GlusterFS for simple replication

newbie question. I need to build this: /shared folder ~500GB of files, ~1MB each one. Two boxes (server1 and server2) connected by a 1Gbs LAN Every box needs to get r/w access to the files, so ...
1
vote
2answers
221 views

How to organise storage for media content such as video and music?

Currently, we have a single server hosting all content: music, video and software. This content is downloaded by users through HTTP. Now free space is coming to an end and we are exploring different ...
1
vote
2answers
375 views

What techniques do you use to design and scale a web app horizontally (in EC2)?

Specifically I'm looking for techniques for scaling a web application which has no central database server, in the cloud, but general advice is great. I have come across GlusterFS, which looks great, ...
4
votes
2answers
846 views

How to manage processes-to-CPU cores affinities?

I use a distributed user-space filesystem (GlusterFS) and I would like to be sure GlusterFS processes will always have the computing power they need. Each execution node of my grid have 2 CPU, with 4 ...
1
vote
1answer
2k views

gluster IOPS performance

Can "gluster" serve FLV files without any front-end server layers just using the built-in HTTP protocol ? How would the IOPS compare to standard apache serving? Would gluster help me with I/O limits ...
3
votes
1answer
574 views

Distributed File Systems

So, I've been reading several articles around ServerFault as well as google. (For Example, this link) My Requirements are very similar to the link above, however i'd like to also have dynamic or at ...
3
votes
1answer
2k views

Pitfalls to using Gluster as a home/profile directory server?

I was asking recently about options for divvying up access to file servers, as we have a NAS solution that gets fairly bogged down when our users (with giant profiles, especially) all log in nearly ...
1
vote
4answers
5k views

What is the recommended glusterFS configuration for a growing website?

I have a website that is tracking towards 50 million hits per day average, and within the next 3 months should be over 100 million hits per day. We are trying to use GlusterFS v 3.0.0 (with latest ...
6
votes
4answers
3k views

MogileFS/GlusterFS/etc + Amazon EBS + Amazon EC2

I have a web application that serves binary files (images, etc). Our application runs on Amazon EC2. We were originally going to use Amazon S3 to store and serve these files, this is no longer an ...