Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

learn more… | top users | synonyms

0
votes
0answers
7 views

Ceph Cluster Switch Specifications [duplicate]

What's more important when building a 10GbE Ceph cluster - switches that have larger buffers or switches that have less latency?
1
vote
1answer
74 views

ceph - can't start osd on rebooted cluster host

I've rebooted the server (one of ceph's hosts). Started the cluster, but the osd, that's on the host, which was rebooted is down. The osd's # is 2, so when I try: sudo /etc/init.d/ceph start osd.2 ...
0
votes
0answers
112 views

Ceph: librados: client.admin authentication error (1) Operation not permitted

I'm trying to setup Ceph cluster (actually 1 server). I had problems and decided to remove and reinstall everything. And now I can't get rid of this error with ceph -s: 2016-04-07 17:14:46.743049 ...
0
votes
0answers
49 views

Ceph: How to generate mds/osd keyring?

I try to setup a Ceph cluster in Ubuntu. I have a running monitor, but can't do next steps. Always get: RuntimeError: bootstrap-mds (osd) keyring not found; run 'gatherkeys' But gatherkeys gives: ...
1
vote
0answers
120 views

ceph osd down and rgw Initialization timeout, failed to initialize after reboot

Centos7.2, Ceph with 3 OSD, 1 MON running on a same node. radosgw and all the daemons are running on the same node, and everything was working fine. After reboot the server, all osd could not ...
0
votes
0answers
19 views

ceph MDS service crashes repeatedly with failed assert

I have a small ceph cluster (2 OSD, 1 MON, 1 MDS.) The cluster has been really stable, but in the last week it has become basically unusable. When I look in the log, I see: mds/MDCache.cc: 269: ...
0
votes
0answers
48 views

Ceph Gateway always shows error 500

I have problem with radosgw. I have pass this tutorial but without success: http://docs.ceph.com/docs/hammer/radosgw/config/ When I try: curl http://porunov.com I always get the same page: ... <...
0
votes
1answer
48 views

Ceph installs without init scipts. How do I get them?

I have installed ceph in 3 centos7 nodes with ceph-deploy tool. All works good but I haven't any script to manage ceph or radosgw. My /etc/init.d/ folder contains only these: functions, network, ...
0
votes
1answer
689 views

Ceph: HEALTH_WARN clock skew detected

I have configured ntp on Ceph nodes and time is synchronized! But ceph status always shows clock skew. ceph health detail shows: mon.node2 aadr 192.168.56.102:6789/0 clock skew 7192.45s > max 0....
0
votes
1answer
220 views

OpenShift Origin and Ceph persistent volume

I have installed OpenShift Origin from latest ansible install. (CentOS 7 - 3 masters and 7 nodes) [root@master-1 ~]# openshift version openshift v1.1.0.1-1-g2c6ff4b kubernetes v1.1.0-origin-1107-...
2
votes
1answer
84 views

Make ceph minimize spread of file parts over OSDs

I am considering an option of ceph as distributed filesystem for my home-made MAID (massive array of idle drives). As far as I understand, Ceph oriented for cluster use and spread data evenly over ...
0
votes
0answers
77 views

How to use Amazon S3 Ceph Interface on Windows

I have 4 ceph nodes running on virtual machines in our corporate network. I've installed a ceph object gateway on admin node. Can I somehow use it in Amazon S3 style from my windows machine in the ...
1
vote
0answers
177 views

How to setup Ceph radosgw to support multi-tenancy?

What are the best options to setup the Ceph radosgw so it supports separate/independent "tenants"? What I'm after: Ensure isolation between tenants, ie: no overlap/conflict in bucket namespace; ...
0
votes
1answer
101 views

Expanding/Growing OCFS2 forever

I have a kvm environment where a shared disk mounted by 2 VMs through rbd ceph. What I would like to know that in the future how is it possible to expand OCFS2 filesystem what I planning to use on top ...
1
vote
0answers
179 views

Unable to add initial monitor to Ceph in RHEL

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/...
0
votes
0answers
127 views

Ceph remain in HEALTH_WARN after osd remove

I have a cluster of 3 servers with cepth storage over 9 disks (3 each server). One osd is going down/out and so I "remove" it, after that system start to rebalance data over the remainig osd but after ...
0
votes
1answer
270 views

How do I mount rbd devices with the fuse driver?

This is a follow-up question from: How do I mount an rbd device from fstab Which I asked some time back. How do I mount rbd devices with the fuse driver? (I can't use the kernel driver from docker ...
0
votes
2answers
81 views

KVM debian wheezy packages with ceph support

Does anybody know any packages out there for kvm which are compiled with RBD support? I have these installed right now: ii kvm 1:1.1.2+dfsg-6+deb7u8 amd64 ...
1
vote
1answer
345 views

Set CRUSHMAP for 3 way on a two node cluster

I have an SSD storage system that contains two nodes with 6 SSD's drives. Not ideal, and so some point I will introduce another node. Right now I'm wanting 3 way replication though. Under a default ...
0
votes
1answer
144 views

Logstash matching ceph client and server separation

So I have a fresh logstash install and I am trying to deploy logstash to get a handle on the logs. I am going through and will eventually segment the logstash filters based on subsystem and ...
4
votes
2answers
961 views

CEPH's raw space usage

I can't understand ceph raw space usage. I have 14 HDD (14 OSD's) on 7 servers , 3TB each HDD ~ 42 TB raw space in total. ceph -s osdmap e4055: 14 osds: 14 up, 14 in pgmap v8073416: ...
1
vote
1answer
239 views

After initial deployment Ceph cluster stays in active+degraded state

I've created a small Ceph cluster following quick start guide with one exception, I've used a separate disk for OSDs rather than a folder. Instead of ceph-deploy osd prepare node2:/var/local/osd0 ...
2
votes
1answer
2k views

Ceph OSD always 'down' in Ubuntu 14.04.1

I am trying to install and deploy a ceph cluster. As I don't have enough physical servers, I create 4 VMs on my OpenStack using official Ubuntu 14.04 image. I want to deploy a cluster with 1 monitor ...
0
votes
3answers
4k views

Unable to add initial monitor to Ceph in Ubuntu

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/...
1
vote
0answers
435 views

Conditions for “mds cluster is degraded”

I see into Ceph and after running command $ ceph status I meet text "mds cluster is degraded". I try to seek it at official Ceph docs, but nothing find. If I understand correctly, MDS needed for ...
0
votes
1answer
115 views

Simple scheme for backup virtual machine, which drawback of simple DD?

We've been struggling to create the consistent scheme for backup of KVM virtual machines under Proxmox control and Ceph as storage, but still quite often during the vzdump with a snapshot the virtual ...
13
votes
1answer
1k views

Cause of page fragmentation on “large” server with xfs, 20 disks and Ceph

Any insight from someone with a bit of experience in the linux IO system would be helpful. Here is my story: Recently brought up a cluster of six Dell PowerEdge rx720xds to serve files via Ceph. ...
1
vote
1answer
909 views

Why is GlusterFS so slow here?

We've set up a mirroring pair of GlusterFS servers. No special tuning, whatever came "out of the box" with GlusterFS-3.5.1 in the official RHEL6 RPM, that's what we have. The cluster works, but the ...
-2
votes
1answer
192 views

What's the best way to sync folders across 03 or more webservers? [closed]

I have 03 servers and I want to sync some folders across them. I'm using DRBD + OCFS2 for a year or so, but it doesn't support more than 02 servers right now. I read about GlusterFS and CEPH, but ...
1
vote
1answer
1k views

DELL FS12-SC PERC 6/i replacement with JBOD support? [closed]

I have 3 DELL FS12-SC servers with a bunch of 3TB drives (issue number 1, the perc 6/i doesn't appear to support 3TB drives). I'm setting up a ceph cluster and need to run the drives in JBOD mode. The ...
3
votes
1answer
276 views

How can I measure complex I/O activity to develop realistic benchmarking? [closed]

I need to retrieve a few metric from my service server to benchmark another stroage solution. There are various options are provied by benchmark program(I choosed FIO,http://freecode.com/projects/fio)....
4
votes
1answer
1k views

Which iscsi target on linux for serving vSphere? [closed]

All such questions are a bit dated; I'm hoping things have changed in the past year. What do you guys use to serve a DRS cluster with vSphere 5.1/5.5? SCSI-3 persistent reservation support would be ...
0
votes
2answers
586 views

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster ...
0
votes
3answers
205 views

File system benchmark that generates I/O from distribution of file sizes [closed]

I am looking for a file system benchmarking tool to test CephFS. This benchmarking tool has to: Generate a set of files (call it fileset) following a particular distribution, e.g., gamma, empirical, ...
1
vote
1answer
4k views

How do I mount an rbd device from fstab

According to this link: http://docs.ceph.com/docs/master/start/quick-rbd/ I can mount an rbd, which works perfectly. The question I have is how do I do this from fstab? The end goal being to mount ...
2
votes
1answer
284 views

What kind of “volume/storage management” has the largest support/feature set these days? [closed]

(DISCLAIMER: This is "time bound" as probably every other question, I just point it out now instead of implicating it) part of reviewing a few basic decisions for our infrastructure is once again the ...
0
votes
2answers
942 views

how to use ceph in a backup environment

I want to pool a large number of hard drives over the network to provide a large backup space. I want also to partition this space and make it available to several machines as a backup space. I ...
1
vote
3answers
2k views

How to mount ceph-fuse automatically with fstab?

# ceph -v ceph version 0.56.3 (6eb7e15a4783b122e9b0c85ea9ba064145958aa5) # repoquery -i ceph Name : ceph Version : 0.56.3 Release : 1.el6 Architecture: x86_64 Size : 26734691 ...
1
vote
1answer
2k views

copy kvm image from ceph to other storage

A while ago I created a ceph storage cluster and connected it to proxmox2 according to the method described in http://pve.proxmox.com/wiki/Storage:_Ceph. We have some kvm images running on the ceph ...
0
votes
1answer
1k views

Object storage: when to choose OpenStack (Swift) vs. Ceph

Swift (OpenStack) and Ceph are both open source projects that implement object storage. What are the factors to consider when trying to decide which one to deploy? Under what scenarios would you ...
3
votes
3answers
1k views

Does it work to run mysql with the data directory on a CephFS mount?

We have a database cluster that uses MySQL on DRBD with Pacemaker+Corosync, which is great. My question is whether it is possible (and whether anyone has been successful) to mount a CephFS drive to /...
-2
votes
1answer
947 views

How exactly are Distributed File Systems used in cloud environment? [closed]

How exactly are Distributed File Systems used in cloud environment ? More precisely: Are live VMs images (or their filesystem) usually located in the DFS ? Are VMs usually used to run the backbone (...