I want to test Ceph (a distributed network storage and file system) on some EC2 hosts which is derived from Amazon Linux AMI (amzn-ami-2011.09.2.x86_64-ebs).

The kernel version is 3.2 and btrfs is enabled. But kernel config options related to Ceph (CONFIG_CEPH_FS and CONFIG_BLK_DEV_RBD) seems to be disabled.

I have to make a new kernel and register it to amazon ? Or, does someone know more easy way ?


Although CONFIG_CEPH_FS can be built as a module, CONFIG_BLK_DEV_RBD cannot, so if you want a kernel that includes these options, you'll need to create your own AMI. However, if you're really lucky, you may be able to find an AMI that already includes the changes--but I don't see any obvious ones off the bat.

There are some posts dealing with recompiling the kernel; for example, on Ubuntu 10.04, although you'll find similar guides all over the place with a Google search.

At the very least, you may want to make sure your newly recompiled AMI is freely available to others, and you may even want to contribute the name upstream to the Ceph FS guys--since its a distributed file system, operating on EC2 sounds like a pretty common use case for it. And I'm sure the next person that wants to test it will appreciate your contribution!

|improve this answer|||||
  • 1
    Thanks Andrew. I succeeded in setting 3 ceph cluster servers and 1 client, with kernel module (not FUSE) on Amazon EC2 environment (Amazon Linux AMI). No need to make a new AMI. Amazon Linux AMI has "get_reference_source" command to get kernel.src.rpm. We can re-compile it with CONFIG_CEPH_FS and CONFIG_BLK_DEV_RBD). Later, I will post the details. – takaomag Apr 18 '12 at 15:07
  • 1
    Right, but you'll need to take a snapshot of the instance and, at that point, it's just as easy (and would helpful for others!) to create an AMI that others can use. – Andrew M. Apr 18 '12 at 22:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.