CephNotes

Some notes about Ceph
Laurent Barbe @Adelius / INRAE

Ceph RBD with LXC containers

Update on Apr 14th, 2016: LXC 2.0.0 First Support for Ceph RBD : http://cephnotes.ksperis.com/blog/2016/04/14/lxc-2-dot-0-0-first-support-for-ceph-rbd %}

A simple way to secure your data with containers is to use a distributed storage such as Ceph for LXC root storage.

For exemple :

# lxc-create -n mycontainer …

OpenNebula 4.8 with Ceph Support on Debian Wheezy

A quick howto to install OpenNebula 4.8 with support for Ceph on Debian Wheezy.

$ onedatastore show cephds
DATASTORE 101 INFORMATION                                                       
ID             : 101                 
NAME           : cephds              
USER           : oneadmin            
GROUP          : oneadmin            
CLUSTER        : -                   
TYPE           : IMAGE               
DS_MAD         : ceph                
TM_MAD         : ceph                
BASE PATH      : /var/lib/one//datastores/101
DISK_TYPE      : RBD        

OpenNebula Installation

OpenNebula Frontend

Install …

Remove pool without name

For exemple :

# rados lspools
data
metadata
rbd
                            <---- ?????
.eu.rgw.root
.eu-west-1.domain.rgw
.eu-west-1.rgw.root
.eu-west-1.rgw.control
.eu-west-1.rgw.gc
.eu-west-1.rgw.buckets.index
.eu-west-1.rgw.buckets
.eu-west-1.log


# ceph osd dump | grep "pool 4 "
pool 4 '' replicated size 2 min_size 1 crush_ruleset 0 object_hash rjenkins pg_num 8 …

Ceph Node.js bindings for librados

var cluster = new rados.Rados( "ceph", "client.admin", "/etc/ceph/ceph.conf");
cluster.connect();

var ioctx = new rados.Ioctx(cluster, "data");
ioctx.aio_write("testfile2", new Buffer("1234567879ABCD"), 14, 0, function (err) {
    if (err) {
      throw err;
    }
    ...

To my knowledge, there is not yet any wrapper Node.js for librados. (I guess …

Ceph Primary Affinity

This option allows you to answer a fairly constant worry in the case of heterogeneous cluster. Indeed, all the discs do not have the same performance or not the same ratio performance / size. With this option it is possible to reduce the load on a disk without reducing the amount …