Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

1
vote
0answers
144 views

Using NFS Mounts as Long Term Container Storage

this is more of a question of best practice than anything. I currently have a proxmox clustered deployment of three servers, all accessing a ceph cluster (that is self hosted on the same servers). ...
1
vote
1answer
2k views

Ceph Pool Snapshot for CephFS Backup and/or Data Recovery

Since CephFS does not support snapshot yet, could we use Ceph Pool Snapshot for backup purpose from accidental deletion of files inside CephFS? ceph osd pool mksnap {pool-name} {snap-name} ceph osd ...
0
votes
1answer
1k views

Using available space in a Ceph pool

Here's what my Ceph situation looks like (from ceph df): GLOBAL: SIZE AVAIL RAW USED %RAW USED 596G 593G 3633M 0.59 POOLS: NAME ...
1
vote
1answer
144 views

Can VM hard disk size be bigger than single SSD in Ceph Storage?

I have a 3 node ceph proxmox cluster for storage with node1 7*143GB ssds, node2 7*143 ssds, node3 7*218 ssds. Now I have read through the http://docs.ceph.com/docs/jewel/architecture/#mapping-pgs-to-...
3
votes
1answer
5k views

Ceph OSD always 'down' in Ubuntu 14.04.1

I am trying to install and deploy a ceph cluster. As I don't have enough physical servers, I create 4 VMs on my OpenStack using official Ubuntu 14.04 image. I want to deploy a cluster with 1 monitor ...
1
vote
1answer
2k views

Will running Ceph (or similar systems) virtualized degrade its performance?

I am setting up a Ceph cluster. The client is asking for it to be done in virtual machines, one hypervisor / VM per server. Given my previous (minor) experience with virtual machines, I wonder if ...
3
votes
1answer
44 views

Shared and replication filesystem support POSIX

I'm looking for opensource solution that support my use case. I have now 4 node on my cluster network and i need this. Store file system (huge list) Replication my file save on one node and replicate ...
1
vote
2answers
1k views

How do I mount rbd devices with the fuse driver?

This is a follow-up question from: How do I mount an rbd device from fstab Which I asked some time back. How do I mount rbd devices with the fuse driver? (I can't use the kernel driver from docker ...
1
vote
4answers
14k views

Unable to add initial monitor to Ceph in Ubuntu

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/...
3
votes
1answer
3k views

Why is GlusterFS so slow here?

We've set up a mirroring pair of GlusterFS servers. No special tuning, whatever came "out of the box" with GlusterFS-3.5.1 in the official RHEL6 RPM, that's what we have. The cluster works, but the ...
0
votes
1answer
620 views

OpenStack Redundant Ceph/Cinder Storage Architecture

Hello Serverfault community, I'm currently designing an OpenStack cluster. The part where I'm currently stuck is the Storage Architecture. I thought of building two redundant Ceph clusters in ...
1
vote
1answer
555 views

Use Ceph as redundant storage for failover FTP service?

I need to setup a redundant FTP storage service that can survive one server-crash. I have two servers SrvA and SrvB that shares a virtual IP IpVirt (an IP that will usually point to SrvA but that ...
3
votes
0answers
838 views

ceph osd down and rgw Initialization timeout, failed to initialize after reboot

Centos7.2, Ceph with 3 OSD, 1 MON running on a same node. radosgw and all the daemons are running on the same node, and everything was working fine. After reboot the server, all osd could not ...
0
votes
1answer
2k views

Object storage: when to choose OpenStack (Swift) vs. Ceph

Swift (OpenStack) and Ceph are both open source projects that implement object storage. What are the factors to consider when trying to decide which one to deploy? Under what scenarios would you ...
1
vote
0answers
484 views

How to setup Ceph radosgw to support multi-tenancy?

What are the best options to setup the Ceph radosgw so it supports separate/independent "tenants"? What I'm after: Ensure isolation between tenants, ie: no overlap/conflict in bucket namespace; ...
0
votes
1answer
170 views

Ceph installs without init scipts. How do I get them?

I have installed ceph in 3 centos7 nodes with ceph-deploy tool. All works good but I haven't any script to manage ceph or radosgw. My /etc/init.d/ folder contains only these: functions, network, ...
0
votes
1answer
10k views

Ceph: HEALTH_WARN clock skew detected

I have configured ntp on Ceph nodes and time is synchronized! But ceph status always shows clock skew. ceph health detail shows: mon.node2 aadr 192.168.56.102:6789/0 clock skew 7192.45s > max 0....
0
votes
2answers
151 views

KVM debian wheezy packages with ceph support

Does anybody know any packages out there for kvm which are compiled with RBD support? I have these installed right now: ii kvm 1:1.1.2+dfsg-6+deb7u8 amd64 ...
2
votes
1answer
180 views

Make ceph minimize spread of file parts over OSDs

I am considering an option of ceph as distributed filesystem for my home-made MAID (massive array of idle drives). As far as I understand, Ceph oriented for cluster use and spread data evenly over ...
1
vote
1answer
6k views

How do I mount an rbd device from fstab

According to this link: http://docs.ceph.com/docs/master/start/quick-rbd/ I can mount an rbd, which works perfectly. The question I have is how do I do this from fstab? The end goal being to mount ...
0
votes
1answer
249 views

Expanding/Growing OCFS2 forever

I have a kvm environment where a shared disk mounted by 2 VMs through rbd ceph. What I would like to know that in the future how is it possible to expand OCFS2 filesystem what I planning to use on top ...
1
vote
0answers
568 views

Unable to add initial monitor to Ceph in RHEL

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/...
0
votes
1answer
370 views

Logstash matching ceph client and server separation

So I have a fresh logstash install and I am trying to deploy logstash to get a handle on the logs. I am going through and will eventually segment the logstash filters based on subsystem and ...
7
votes
2answers
4k views

CEPH's raw space usage

I can't understand ceph raw space usage. I have 14 HDD (14 OSD's) on 7 servers , 3TB each HDD ~ 42 TB raw space in total. ceph -s osdmap e4055: 14 osds: 14 up, 14 in pgmap v8073416: ...
1
vote
1answer
708 views

After initial deployment Ceph cluster stays in active+degraded state

I've created a small Ceph cluster following quick start guide with one exception, I've used a separate disk for OSDs rather than a folder. Instead of ceph-deploy osd prepare node2:/var/local/osd0 ...
2
votes
0answers
1k views

Conditions for “mds cluster is degraded”

I see into Ceph and after running command $ ceph status I meet text "mds cluster is degraded". I try to seek it at official Ceph docs, but nothing find. If I understand correctly, MDS needed for ...
0
votes
1answer
153 views

Simple scheme for backup virtual machine, which drawback of simple DD?

We've been struggling to create the consistent scheme for backup of KVM virtual machines under Proxmox control and Ceph as storage, but still quite often during the vzdump with a snapshot the virtual ...
18
votes
1answer
3k views

Cause of page fragmentation on “large” server with xfs, 20 disks and Ceph

Any insight from someone with a bit of experience in the linux IO system would be helpful. Here is my story: Recently brought up a cluster of six Dell PowerEdge rx720xds to serve files via Ceph. ...
-2
votes
1answer
514 views

What's the best way to sync folders across 03 or more webservers? [closed]

I have 03 servers and I want to sync some folders across them. I'm using DRBD + OCFS2 for a year or so, but it doesn't support more than 02 servers right now. I read about GlusterFS and CEPH, but ...
2
votes
1answer
2k views

DELL FS12-SC PERC 6/i replacement with JBOD support? [closed]

I have 3 DELL FS12-SC servers with a bunch of 3TB drives (issue number 1, the perc 6/i doesn't appear to support 3TB drives). I'm setting up a ceph cluster and need to run the drives in JBOD mode. The ...
4
votes
3answers
2k views

Does it work to run mysql with the data directory on a CephFS mount?

We have a database cluster that uses MySQL on DRBD with Pacemaker+Corosync, which is great. My question is whether it is possible (and whether anyone has been successful) to mount a CephFS drive to /...
4
votes
1answer
565 views

How can I measure complex I/O activity to develop realistic benchmarking? [closed]

I need to retrieve a few metric from my service server to benchmark another stroage solution. There are various options are provied by benchmark program(I choosed FIO,http://freecode.com/projects/fio)....
1
vote
2answers
1k views

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster ...
4
votes
1answer
2k views

Which iscsi target on linux for serving vSphere? [closed]

All such questions are a bit dated; I'm hoping things have changed in the past year. What do you guys use to serve a DRS cluster with vSphere 5.1/5.5? SCSI-3 persistent reservation support would be ...
1
vote
3answers
3k views

How to mount ceph-fuse automatically with fstab?

# ceph -v ceph version 0.56.3 (6eb7e15a4783b122e9b0c85ea9ba064145958aa5) # repoquery -i ceph Name : ceph Version : 0.56.3 Release : 1.el6 Architecture: x86_64 Size : 26734691 ...
0
votes
3answers
410 views

File system benchmark that generates I/O from distribution of file sizes [closed]

I am looking for a file system benchmarking tool to test CephFS. This benchmarking tool has to: Generate a set of files (call it fileset) following a particular distribution, e.g., gamma, empirical, ...
2
votes
1answer
340 views

What kind of “volume/storage management” has the largest support/feature set these days? [closed]

(DISCLAIMER: This is "time bound" as probably every other question, I just point it out now instead of implicating it) part of reviewing a few basic decisions for our infrastructure is once again the ...
2
votes
1answer
4k views

copy kvm image from ceph to other storage

A while ago I created a ceph storage cluster and connected it to proxmox2 according to the method described in http://pve.proxmox.com/wiki/Storage:_Ceph. We have some kvm images running on the ceph ...
-2
votes
1answer
1k views

How exactly are Distributed File Systems used in cloud environment? [closed]

How exactly are Distributed File Systems used in cloud environment ? More precisely: Are live VMs images (or their filesystem) usually located in the DFS ? Are VMs usually used to run the backbone (...