Questions tagged [distributed-filesystems]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
3answers
71 views

Can I use RAM as Cache for a secondary storage device

I have 10TB~ RAID 5 array and two NVME 500GB on RAID 0 and they in different systems. what I want is to make a stick of RAM like 16GB or something to act as a cache or buffer to give me faster access ...
1
vote
0answers
32 views

Heavy network usage withg GlusterFS FUSE client

I have a simple GlusterFS 7.2 setup with 3 servers: data1 and data2 contribute several bricks (4 each) to a distributed replicated GlusterFS volume. host1 uses the GlusterFS FUSE client to mount the ...
0
votes
0answers
40 views

Any Open Source Linux Distributed Storage Options Which be Deployed inside Rented KVM VPSes Without Additional Virtual Disks?

I am trying to figure out a scalable and HA solution for storing live data under production workloads like DBs, web contents, etc.. Which can be installed and setup on standard rented Linux KVM VPSes. ...
0
votes
0answers
80 views

drbdmeta 0 v08 /dev/vdc internal create-md' terminated with exit code 20

I am getting below error in drbd create, though my one server only having issue other server with same partationm name configured properly. [root@xxxxxx drbd.d]# drbdadm create-md filerun read from ...
0
votes
1answer
37 views

GlusterFS - Define Failover Cluster

I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a ...
0
votes
0answers
18 views

How to set up a distributed filesystem in a mixed network?

Well, having lots of practically unused partitions on PCs throughout my network made me try to come up with ways to make all this storage capacity usable. On a Linux only network I'd probably have a ...
1
vote
1answer
69 views

Ridiculous Number of Files in a Directory

My employer acquired a company with one particular piece of software that stores a lot of PDF and PNG file files in one directory. When I first replicated it from AWS, there were about 11.5 million ...
0
votes
1answer
27 views

Change HDFS replication factor

I've changed replication factor from 3 to 2 for some directories with command: hdfs dfs -setrep -R 2 /path/to/dir but my HDFS free space still the same. Should I do something else to free my disks?
1
vote
1answer
119 views

Can kubernetes cluster nodes be geologically spread out?

Me and a couple of friends are thinking of setting up a kubernetes cluster where our homeservers will act as the nodes. As our nodes will be spread out between our apartments I am worried this will ...
1
vote
1answer
218 views

AWS EFS - file delete and recreate not detected programmatically for 25 to 30 seconds

I am observing a very large delay in EFS detecting that a file has been re-created i.e. deleted and then created again. In this simple test example, I have a single file that gets deleted and ...
1
vote
1answer
67 views

Multiple disks acting as one filesystem, while still allowing each disk to be accessed alone

I have a fairly large dataset (~160TB) that need to be delivered to a client every so often. This dataset consists of fairly large files, usually between 2Gb and 20Gb each. They exist on a BeeGFS ...
5
votes
3answers
2k views

What differences are between a NAS, a shared disk file system on a SAN, and a distributed filesystem?

https://en.wikipedia.org/wiki/Clustered_file_system#Network-attached_storage says Network-attached storage (NAS) provides both storage and a file system, like a shared disk file system on top of a ...
1
vote
2answers
188 views

Does a distributed filesystem have to consist of multiple filesystems located on different computers?

Does the concept of a distributed filesystem require a distributed filesystem to consist of multiple filesystems located on different computers? Does an NFS filesystem consist of only one filesystem? ...
1
vote
2answers
76 views

Do distributed file systems partition a file across nodes?

In HDFS, a file is partitioned into blocks which are distributed across several nodes. I am wondering if that is also true in the following distributed file systems: NFS, Andrew File systems (and ...
0
votes
1answer
43 views

How can I create or access a remote file as if it were local?

In general, I would like to run local programs on remote files provided to me via a distributed file system (e.g. samba, NFS or whichever you recommend), and I want to access the remote files in a ...
4
votes
0answers
354 views

How does S3FS (or any other S3 FUSE filsystem) compare to AWS FSx for Lustre + S3

I remember trying s3fs a year back, trying to use some S3 bucket as a FUSE filesystem. I remember it being quite laggy, especially when coupled with git operations on it (an oblivious system architect ...
1
vote
2answers
482 views

K3S arm64 distributed files systems

I deployed a K3S Cluster on arm64 and I need to have a DFS directly on-premise, It will be better to have it running on the kubernetes stack. Regarding DFS choices there are some options, but...: ...
0
votes
0answers
21 views

Will DFRS support a lot of data over a WAN?

I have a server in our home location that houses many of our engineers. This location has Comcast fiber 100 up and down. Internally, the network here is much faster than that. This location has Server ...
0
votes
1answer
673 views

glusterfs client mount point fails with 'Client quorum is not met'

Assume a basic replica 3 arbiter 1 configuration, glusterfs-server 4.0.2 and glusterfs-client 4.0.2. glusterfs-client is installed on Ubuntu 18.04. In order to verify that write / read ops are ...
3
votes
1answer
355 views

Does Perkeep (camlistore) have built in protection from bitrot?

Does Perkeep (PKA Camlistore) offer protection from silent corruption (eg. bitrot) of the data in its current design like what is offered in ZFS. If it does, how well does it fare when compared to ZFS?...
1
vote
2answers
3k views

DFS Namespace unavailable at login

Edit: I was not fully aware of what was going on with my issue, but it has since been fixed. See my answer below. Background We are having some issues with DFS namespaces in our environment after a ...
2
votes
1answer
168 views

Which distributed filesystem will actually fit my needs?

Hear me out I have seen the question asked (in different forms) here, here, and perhaps the best one I found was here, but I do not think this is a duplicate because quite some time has past since ...
1
vote
0answers
166 views

Is it practical to keep home directories on OpenAFS?

I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various ...
0
votes
2answers
570 views

Networked In-Memory FileSystem w/ zram + XFS + GlusterFS - Best Practices

A few months ago I used XFS formatted zram devices strung together with GlusterFS to create a distributed / networked / replicated in-memory filesystem on a few bare metal servers (running RHEL 7.2). ...
1
vote
2answers
819 views

Asynchronous file replication over long distances, with buffering

I'm looking for a filesystem that can replicate over long distances, and tolerate being offline for extended periods of time by using a local buffer, which should be a disk buffer, to queue up changes ...
2
votes
1answer
712 views

How to make GlusterFS mount point highly available?

It's true that one can mount a GlusterFS volume on any brick and the FUSE client will automatically discover the other bricks and connect to them as well. If the initial brick fails the client will ...
0
votes
1answer
46 views

GlusterFS server logic

I quite don't understand about GlusterFS probes. See, i add all servers to /etc/hosts file and i do this for each server. Lets say i have 100 servers and later i added 100 more. I cannot imagine ...
4
votes
1answer
15k views

GlusterFS Transport endpoint not connected from time to time

I'm using GlusterFS 3.7.9, currently on a single server with 4 bricks. Each brick has 4TB and the volume is set up as distribute only. The volume is mounted on a secondary server and I use it for ...
4
votes
2answers
691 views

GlusterFS alternative for file upload website

I have a few file upload websites, with files ranging from hundreds of kilobytes to a few gigabytes. Currently I have all files in a distribute-replicate Gluster volume on a few servers. My ...
2
votes
1answer
286 views

Glusterd dead but cluster still running

We are currently running a three node cluster, on Gluster 3.6.4. On one of our nodes we noticed that the glusterd daemon is dead. But the glusterfsd daemons are still running, and we believe clients ...
1
vote
0answers
17 views

Is it possible to configure hdfs in a federation mode and in an HA mode in the same time?

I don't understand if it possible to configure HDFS in both modes in the same time. Does it make sense? Can somebody show a simple configuration of HDFS in both modes? (nameNode1, nameNode2, ...
1
vote
1answer
306 views

How to safely store data and DBs on Kubernetes (or similar) on DigitalOcean

It boils down to setting up a private cloud on something like Digital Oceans versus another hosting solution like GCE or AWS. The latter have redundant data stores that can be safely used as volumes, ...
0
votes
1answer
1k views

New files on Linux Samba share: Now you don't see me, now you do

When a file is uploaded to our server, we have to do some work on it to allow or reject it. Some files need to be opened in a Windows box (OpenXml Sdk performance reasons). Our web server runs in a ...
2
votes
1answer
88 views

distributed storage solutions [closed]

I've got some desktop PCs available in my company since the last user hardware renewal and I would like to re-use them for a demo plaform. They are powerfull enought to emulate a few servers. I ...
1
vote
0answers
741 views

Glusterd won't start after node crash

We had a 2 node cluster running GlusterFS. It's a 4 volume cluster, replica 2, one brick per server. Dead server: nnfs02 Live server with all data: nnfs03 New server: nnfs01 After nnfs02 died, we ...
6
votes
2answers
558 views

What is reasonable storage failover time that most OS (VM) can tolerate?

I have a GlusterFS 2 node 2 replica setup. I am planning to use it as OpenStack instance store, in which the VM disk image is stored. From my tests, if the GlusterFS node which the hypervisor ...
3
votes
1answer
1k views

Distributed mirrored filesystem under FreeBSD

Can someone share their experience in building a distributed mirrored filesystem between multiple FreeBSD machines? I. e. we have two (three, four...) servers and special partition "part1" mounted on ...
0
votes
1answer
328 views

Expanding/Growing OCFS2 forever

I have a kvm environment where a shared disk mounted by 2 VMs through rbd ceph. What I would like to know that in the future how is it possible to expand OCFS2 filesystem what I planning to use on top ...
0
votes
1answer
394 views

Storing Large Amount of files in a file system?

Guys I am creating an application which will be saving a .txt file (approx 10 KB/file I guess) in a file system and will be saving its path in MS SQL database. Now as per my estimation, approximately ...
1
vote
3answers
3k views

LizardFS/MooseFS — Multiple Storage Volumes

I'm using the new LizardFS and it's awesome! I'm new to LizardFS/MooseFS overall, but it seems pretty straight-forward. I was wondering two things: First, is there a way to setup separate storage ...
5
votes
2answers
2k views

Is there a way to connect a remote folder with local cache on OSX or Windows workstation?

A company with 50 graphic designers are working on the same file server. They are using mainly Indesign. A typical project is a 60 pages indesign document with 1.5GB of linked files (something like ...
4
votes
1answer
3k views

Why is GlusterFS so slow here?

We've set up a mirroring pair of GlusterFS servers. No special tuning, whatever came "out of the box" with GlusterFS-3.5.1 in the official RHEL6 RPM, that's what we have. The cluster works, but the ...
6
votes
0answers
170 views

Fast distributed filesystem for a large amounts of data with metadata in database [closed]

My project uses several processing machines and one storage machine. Currently storage organized with a MSSQL filetable shared folder. Every file in storage have some metadata in database. Processing ...
1
vote
2answers
228 views

Setting up a multi-host SAN

I'm looking for some advice on setting-up multi-host I/O access on our SAN: I have a blade enclosure (PowerEdge1000e) containing an Equallogic PS-M4110 storage blade with a single RAID6 volume ...
1
vote
2answers
439 views

Simple, decentralized, automatically synced, local cached file share for linux server

I wonder if someone could recommend me some solution to sharing files between a small amount of linux VPS (virtual private servers). Basically I have a bunch of linux VPS to manage, and I want to ...
4
votes
2answers
3k views

what distributed file system for a two-node failover setup?

I'm trying to set up a redundant setup consisting of two servers that have everything redundant: the database (MySQL master-master in active/passive mode) the file system (distributed/replicated) ...
4
votes
1answer
3k views

In a distributed filesystem like MooseFS or XtreemFS, should individual nodes expose “raw-er” storage, or LVM'd storage?

When preparing an infrastructure to utilize a distributed storage system like MooseFS or XtreemFS, how should individual nodes present storage to the rest of the environment? Is it better for ...
2
votes
4answers
1k views

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster ...
0
votes
2answers
78 views

Distribute all services between 3 VPS [closed]

i just rent 3 vps servers with this: 4GB RAM 150GB hard disk 2 CPU 6 ip address so we have vps1, vps2 and vps3 and i'm thinking distribute the services like this: VPS1 - frontend + DNS Server + ...
0
votes
3answers
564 views

File system benchmark that generates I/O from distribution of file sizes [closed]

I am looking for a file system benchmarking tool to test CephFS. This benchmarking tool has to: Generate a set of files (call it fileset) following a particular distribution, e.g., gamma, empirical, ...