楼主:
xxoo1122 (一个连IE6都能相容的男人)
2014-10-31 23:25:32Ceph(http://ceph.com)最近还满热门的,小弟今天来分享一下如何快速部署,
先介绍一下Ceph是新一代的分布式储存系统,Ceph提供Object storage,
Block device storage,File system的服务（Ceph的File system还不稳请勿用
于生产环境）,今天将介绍Block device storage的部分.
组件简介：
osd: Object Storage Device, 负责提供储存资源
monitor: 监控Ceph Cluster状态
mds: 储存Cephfs 的元数据, 非必要支组件, 只有Cephfs需要此组件
实验环境共４台服务器
1台Ceph-deploy,3台OSD+MON,每台主机都有两颗硬盘,
代号sda,sdb sda用来安装作业系统
作业系统：ubuntu 14.04
|Hostname |Ip address |Role |
|__________|_____________|_________|
|ceph-admin|192.168.60.1 |admin |
|ceph-1 |192.168.60.2 |mon+osd |
|ceph-2 |192.168.60.3 |mon+osd |
|ceph-3 |192.168.60.4 |mon+osd |
|__________________________________|
步骤一：修改4台主机的/etc/hosts
192.168.60.1 ceph-admin
192.168.60.2 ceph-1
192.168.60.3 ceph-2
192.168.60.4 ceph-3
步骤二：产生ssh密钥,并复制到其他node
ceph-admin#ssh-keygen
ceph-admin#ssh-copy-id ceph-1
ceph-admin#ssh-copy-id ceph-2
ceph-admin#ssh-copy-id ceph-3
步骤三：在admin上增加cepg apt repo
ceph-admin#wget -q -O- 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys
/release.asc' | sudo apt-key add -
ceph-admin#echo deb echo deb http://ceph.com/debian-firefly/ $(lsb_release -sc)
main | sudo tee /etc/apt/sources.list.d/ceph.list
ceph-admin#apt-get update && apt-get install ceph-deploy
步骤四：部署 以下动作依然都是在ceph-admin上完成
(1)建立工作目录
ceph-admin#mkdir ~/ceph && cd ~/ceph
(2)建立Cluster,默认cluster名称为ceph
ceph-admin#ceph-deploy new ceph-1 ceph-2 ceph-3
(3)在所有node上安装ceph套件
ceph-admin#ceph-deploy install ceph-1 ceph-2 ceph-3
(4)建立mon
ceph-admin#ceph-deploy mon create ceph-1 ceph-2 ceph-3
(5)将所有node的密钥都复制到工作目录
ceph-admin#ceph-deploy gatherkeys ceph-1 ceph-2 ceph-3
(6)增加osd
ceph-admin#ceph-deploy prepare ceph-1:/dev/sdb ceph-2:/dev/sdb ceph-3:/dev/sdb
ceph-admin#ceph-deploy activate ceph-1:/dev/sdb ceph-2:/dev/sdb ceph-3:/dev/sdb
(7)复制admin密钥到所有node
ceph-admin#ceph-deploy admin ceph-1 ceph-2 ceph-3
(8)最后检查部署状态
ceph-1#ceph health
HEALTH_OK
出现HEALTH_OK代表cluster运作正常
步骤五：挂载block device
(1)挂载rbd内核模组
ceph-client#modprobe rbd
(2)建立一个4G的image
ceph-client#rbd create