0

I'm trying to achieve similar thing to raid6 on ceph.

But When I'm creating erasure coded pools (k=3 + m=2(or k=4) ) I always get inactive pgs.

ceph health details are:

HEALTH_WARN Reduced data availability: 128 pgs inactive
PG_AVAILABILITY Reduced data availability: 128 pgs inactive
    pg 11.a is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.b is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.c is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.d is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.e is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.f is stuck inactive for 107.974251, current state unknown, last acting []
    pg 11.20 is stuck inactive for 107.974251, current state unknown, last acting []

EC profile is:

crush-device-class=
crush-failure-domain=rack
crush-root=default
jerasure-per-chunk-alignment=false
k=4
m=2
plugin=jerasure
technique=reed_sol_van
w=8

also tried with k=3, the same thing happens

Crush rule (for k=4):

{
    "rule_id": 1,
    "rule_name": "r6pool",
    "ruleset": 1,
    "type": 3,
    "min_size": 3,
    "max_size": 6,
    "steps": [
        {
            "op": "set_chooseleaf_tries",
            "num": 5
        },
        {
            "op": "set_choose_tries",
            "num": 100
        },
        {
            "op": "take",
            "item": -1,
            "item_name": "default"
        },
        {
            "op": "chooseleaf_indep",
            "num": 0,
            "type": "rack"
        },
        {
            "op": "emit"
        }
    ]
}

Since everything is fine If not using EC pools, I'm pretty sure I don't understand something, but I'm unable to target my mistake.

To get this error on completely good 8 OSD Cluster I'm just doing:

ceph osd erasure-code-profile set raid6 k=3 m=2
ceph osd pool create r6pool 128 128 erasure raid6

and ceph -s shows this:

ceph -s
  cluster:
    id:     7635eaf1-df47-4bed-9cef-a3152cb4fa5f
    health: HEALTH_WARN
            Reduced data availability: 128 pgs inactive

  services:
    mon: 3 daemons, quorum CephMon1,CephMon3,CephMon2
    mgr: CephClient(active)
    osd: 9 osds: 8 up, 8 in

  data:
    pools:   2 pools, 256 pgs
    objects: 0 objects, 0B
    usage:   8.13GiB used, 31.8GiB / 40.0GiB avail
    pgs:     50.000% pgs unknown
             128 active+clean
             128 unknown

I'll be very gratefull for any help. Thanks.

0

Well an:

crush-failure-domain=osd

solved the puzzle

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.