Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

0
votes
2answers
845 views

RAID-0 stripe size for Ceph OSD

I have 3 servers that I will use for a new Ceph cluster. It's my first Ceph "playground"... Each server has 2x1TB and 6x2TB HDDs connected to two separate 4-channel SAS controllers, each with 1GB ...
0
votes
2answers
1k views

Ceph PG's stuck creating / Pool creation slow

I've created a small ceph cluster 3 servers each with 5 disks for osd's with one monitor per server. The actual setup seems to have gone OK and the mons are in quorum and all 15 osd's are up and in ...
0
votes
2answers
152 views

KVM debian wheezy packages with ceph support

Does anybody know any packages out there for kvm which are compiled with RBD support? I have these installed right now: ii kvm 1:1.1.2+dfsg-6+deb7u8 amd64 ...
0
votes
2answers
1k views

how to use ceph in a backup environment

I want to pool a large number of hard drives over the network to provide a large backup space. I want also to partition this space and make it available to several machines as a backup space. I ...
-1
votes
2answers
221 views

How to add Hetzner Cloud Disk Volume to extend /var partition?

I have a new Hetzner cloud server and added an extra 50GB disk volume (CEPH) to my server. The default disk is only 40GB. I thought it would be added to the default storage like the traditional ...
3
votes
1answer
524 views

CTDB Samba failover not highly available

TL;DR Failing a node in a ctdb + samba cluster while interacting with a share interrupts share connection. here and here state there is work in progress to make this possible here states it is ...
1
vote
1answer
1k views

Set CRUSHMAP for 3 way on a two node cluster

I have an SSD storage system that contains two nodes with 6 SSD's drives. Not ideal, and so some point I will introduce another node. Right now I'm wanting 3 way replication though. Under a default ...
0
votes
1answer
35 views

Ceph - Erasure Coded Pools - Always get inactive pgs

I'm trying to achieve similar thing to raid6 on ceph. But When I'm creating erasure coded pools (k=3 + m=2(or k=4) ) I always get inactive pgs. ceph health details are: HEALTH_WARN Reduced data ...
0
votes
1answer
18 views

Ceph Erasure Profile with k+m> 6 disks -> PGs to be stuck on creating+incomplete state forever

So my pools has 5 nodes with 12 osds each of 8tb. Currently I am trying to create an erasure coded pool of k=8 m=2, however after adding this profile and create an ecpool with this profile the pools ...
0
votes
1answer
54 views

mount cephfs or rbd via Internet

Is there any suitable solution for this? I know about security issues, but is it possible? Or other better storage solutions? We tested s3fs+cephrgw, but It's very slow and unstable.
0
votes
1answer
910 views

install grub in a usb and boot proxmox from another drive

Good morning my friends! I'm tryng a solution before buy some new hardware. So this is my situation: I have some beautifull hp dl360p gen8 that comes with an p420i hardware raid controller. What ...
0
votes
1answer
623 views

OpenStack Redundant Ceph/Cinder Storage Architecture

Hello Serverfault community, I'm currently designing an OpenStack cluster. The part where I'm currently stuck is the Storage Architecture. I thought of building two redundant Ceph clusters in ...
0
votes
1answer
252 views

Expanding/Growing OCFS2 forever

I have a kvm environment where a shared disk mounted by 2 VMs through rbd ceph. What I would like to know that in the future how is it possible to expand OCFS2 filesystem what I planning to use on top ...
4
votes
0answers
1k views

Better performance when HDD write cache is disabled? (HGST Ultrastar 7K6000 and Media Cache behavior)

Attention, please. Long read. During initial performance tests of Hitachi Ultrastar 7K6000 drives that I'm planning to use in my Ceph setup I've noticed a strange thing: write performance is better ...
3
votes
0answers
856 views

ceph osd down and rgw Initialization timeout, failed to initialize after reboot

Centos7.2, Ceph with 3 OSD, 1 MON running on a same node. radosgw and all the daemons are running on the same node, and everything was working fine. After reboot the server, all osd could not ...
2
votes
0answers
295 views

What is the correct usage of ceph-objectsore-tool?

I am trying to export data for pg, but am getting errors from ceph-objectstore-tool. I see some examples online of usage which seem to match this, and reading through the usage statement that the ...
2
votes
0answers
544 views

Slow fsync() with ceph (cephfs)

I have built an experimental ceph cluster - 12 nodes, 50 osds, 3 mons, 3 mds, for which I'm trying to run a samba gateway. It seems that when writing lots of small files, the fsync() system calls from ...
2
votes
0answers
1k views

Conditions for “mds cluster is degraded”

I see into Ceph and after running command $ ceph status I meet text "mds cluster is degraded". I try to seek it at official Ceph docs, but nothing find. If I understand correctly, MDS needed for ...
1
vote
0answers
53 views

Hung kernel tasks after unclean shutdown of ceph cluster

I am running ceph (created by the rook-ceph operator v0.9.3) on kubernetes v1.13. After an unclean shutdown of our cluster, some processes randomly go into uninterruptible sleep. After some time, the ...
1
vote
0answers
21 views

How wide (data + parity) would you go for erasure coded pools / raid 6?

I am currently doing k=8 and m=2 or in other words data = 8 + parity = 2 shards I am using an all hdd ceph cluster. I have thought about going data = 11 + parity = 2 which would save a lot of ...
1
vote
0answers
30 views

openstack instance's image name lost after integration with ceph rbd

after integrated with ceph rbd,my openstack could not show "image name" of my instance, is there any option that controlling this feature?
1
vote
0answers
30 views

Tried to recover a Ext4 Superblock to a CEPH disk

We have a server with Proxmox installed with Debian, it's an dedicated server (sda). The VM's are being backed up every night on a CEPH disk (sdb). After an reboot of the dedicated, the ext4 drive ...
1
vote
0answers
253 views

Slow samba write speed to ceph backend

I have backend on cephfs cluster, mounted on gateway. Mount path is shared with samba 4.7.4. But my speed is low, about 1,5MB/s with small files (1k - 100k). I copy ot with win server 2008 client. ...
1
vote
0answers
287 views

Ceph is full but disk is almost empty

I have a ceph cluster with 2 nodes and 3 osd's each. Each osd is on one partion on a 8TB disk. The server is limited in amount of disk so I even have system on the same disks. On install I used ...
1
vote
0answers
145 views

Using NFS Mounts as Long Term Container Storage

this is more of a question of best practice than anything. I currently have a proxmox clustered deployment of three servers, all accessing a ceph cluster (that is self hosted on the same servers). ...
1
vote
0answers
493 views

How to setup Ceph radosgw to support multi-tenancy?

What are the best options to setup the Ceph radosgw so it supports separate/independent "tenants"? What I'm after: Ensure isolation between tenants, ie: no overlap/conflict in bucket namespace; ...
1
vote
0answers
578 views

Unable to add initial monitor to Ceph in RHEL

I am trying to set up a Ceph cluster. I have 4 nodes - 1 admin-node, 1 monitor and 2 object storage devices. The installation guide I am using is given at the following location: http://ceph.com/docs/...
0
votes
0answers
10 views

ceph-deploy osd create --data /dev/vdb fails

From my ceph (mimic release) administrative node I ran ceph-deploy osd create --data /dev/vdb ceph0 against a bare metal ceph node and it worked without error. Now I run the same command against a ...
0
votes
0answers
66 views

Filesystem of Proxmox VMs get corrupted when Ceph Node goes down

first of all my highlevel Setup: Proxmox 3 Node Cluster Virtual Environment 5.2-6 on some VMs I use write back caching. ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) ...
0
votes
0answers
12 views

How do I use a non-standard ceph system user?

I configured a ceph user on my cluster named "cepher." I ran ceph-deploy as this user to deploy some servers. Then I see this: [block][INFO ] Running command: sudo ceph --cluster ceph --name client....
0
votes
0answers
14 views

Ceph replicated file permissions

I got a problem with ceph file permissions after replication. For ex. i copied files with permissions 755, but after it got replicated to other ceph osd it got 700, so how to fix it or is there any ...
0
votes
0answers
142 views

How can I mount cephfs on proxmox 5.3?

I have added the pxmx-cephfs.secret (the admin keyring) to /etc/pve/priv/ceph/. Then I proceeded to add cephfs through gui with id pxmx-cephfs and the monitors. While it is added successfully ...
0
votes
0answers
159 views

Ceph vs GlusterFS for elasticsearch storage

Elasticsearch will be holding logs mostly, so we expect sequential read/writes. Does anyone have experience on this? Elasticsearch will run via openshift, if it makes any difference.
0
votes
0answers
32 views

Is it safe to use CephFS on Bluestore with erasure coding?

Is it safe to use CephFS on Bluestore with erasure coding? There are lots of 3-5 year old articles about bluestore as dev preview. Are there any changes? Also there are some disaster recovery posts ...
0
votes
0answers
19 views

Can I manually remove this from crushmap of Ceph?

I see the removed OSD in crushmap how device124 device124. device 120 osd.120 device 121 osd.121 device 122 osd.122 device 123 osd.123 device 124 device124 <-- device 125 osd.125 device 126 osd....
0
votes
0answers
62 views

Why ceph isn't use all 1Gbit/s bandwith on interface of public network?

We have two networks in Ceph. Public network on 1Gbit/s and Cluster network on 10Gbit/s. But I don't see that clients use whole 1Gbit bandwith interface in OSD node. We use Ceph storage for OpenStack. ...
0
votes
0answers
83 views

How to clone a KVM guest which is RBD back-end?

I was using KVM with libvirt(virsh) & file back-end,I can easily clone a guest with ''virt-clone -o vm01 -n vm02 -f /tmp/vm02.img''. Now I move to ceph's rbd back-end,here comes the question,...