CephNotes

Some notes about Ceph
Laurent Barbe @Adelius / INRAE

Main new features in the latest versions of ceph

It's always pleasant to see how fast new features appear in Ceph. :)

Here is a non-exhaustive list of some of theme on the latest releases :

Kraken (October 2016)

  • BlueStore declared as stable
  • AsyncMessenger
  • RGW : metadata indexing via Elasticseasrch, index resharding, compression
  • S3 bucket lifecycle API, RGW Export NFS version 3 …

Check OSD version

Occasionally it may be useful to check the version of the OSD on the entire cluster :

ceph tell osd.* version
osd.0: {
    "version": "ceph version 0.94.5-224-g4051bc2 (4051bc2a5e4313ac0f6236d7a34ed5fb4a1d9ea2)"
}
osd.1: {
    "version": "ceph version 0.94.5-224-g4051bc2 (4051bc2a5e4313ac0f6236d7a34ed5fb4a1d9ea2)"
}
osd.2: {
    "version": "ceph version 0.94.5-224-g4051bc2 (4051bc2a5e4313ac0f6236d7a34ed5fb4a1d9ea2)"
}
osd.3: {
    "version …

Find the OSD location

Of course, the simplest way is using the command ceph osd tree.

Note that, if an osd is down, you can see "last address" in ceph health detail :

$ ceph health detail
...
osd.37 is down since epoch 16952, last address 172.16.4.68:6804/628

Also, you can use …

LXC 2.0.0 First support for Ceph RBD

FYI, the first RBD support has been added to LXC commands.

Example :

# Install LXC 2.0.0 (ubuntu) :
$ add-apt-repository ppa:ubuntu-lxc/lxc-stable
$ apt-get update
$ apt-get install lxc

# Add a ceph pool for lxc bloc devices :
$ ceph osd pool create lxc 64 64

# To create the container, you only need to …

Downgrade LSI 9207 to P19 firmware

After numerous problems encountered with the P20 firmware on this card model, here are the steps I followed to flash in P19 Version.

Since, no more problems :)

The model of the card is a LSI 9207-8i (SAS2308 controler) with IT FW:

lspci | grep LSI
01:00.0 Serial Attached SCSI …