Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I'm looking for a distributed filesystem which I could use for storing lots of small files (<1MB usually). What I want to get is:

  • 2 servers which have the fs mounted themselves and mirror the data
  • locking support (among reachable nodes)
  • some kind of best-effort automatic resynchronisation after one node goes down and comes back again

What I mean by the resync is that, I'm ok with both servers doing read/write operations even if they split-brain. I'm also ok if a local process obtains a lock if the other host is not reachable. From the resync I expect only a file-level consistent view after a while - that is - if file x is modified on both nodes during a split-brain, I don't really care which one is available after they join again, as long as it's full file, not one block coming from node1 and another block from node2.

Is there a solution like that out there? I see that gluster has some problems with file locks (even in 3.1). I also noticed that OCFS2 will panic if both nodes split-brain. What other filesystem would allow me to do what I want?

share|improve this question
add comment

1 Answer

Gluster is another cluster filesystem, but I'm not sure how this works if one node fails

[MogileFS][2] is an open-source distributed filesystem that can handle many small files and is supposed to have no single point a failure. However I think this lacks locking support. Not sure if it would be feasible to implement locking at the app level instead of in the filesystem?

As I am a new user here I can't post a second hyperlink in an answer, but MogileFS will come up on Google

/edit: I see you only have two servers. Perhaps DRBD will do what you want?

share|improve this answer
    
drbd does only block-level stuff and doesn't really guarantee anything about locking (or concurrent usage really). Gluster has so many open bugs that would affect me, I'm not going to try it now. MogileFS doesn't provide actual mountable filesystem - it's similar to GridFS which I already thought about, but I really don't want to rewrite the application itself. –  viraptor Jan 14 '11 at 18:13
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.