openstack与ceph整合安装指导文档.docx
- 文档编号:24886198
- 上传时间:2023-06-02
- 格式:DOCX
- 页数:16
- 大小:277.37KB
openstack与ceph整合安装指导文档.docx
《openstack与ceph整合安装指导文档.docx》由会员分享,可在线阅读,更多相关《openstack与ceph整合安装指导文档.docx(16页珍藏版)》请在冰豆网上搜索。
openstack与ceph整合安装指导文档
openstack与ceph整合安装指导文档
1概述
本文档描述openstack在glance、cinder、nova组件后端如何配置使用ceph来进行存储。
2版本配套表
软件
版本
说明
openstack
icehouse
ceph集群
0.80.5
ceph客户端
0.81
Libvirt
1.1.4
qemu
1.6.1
ceph操作系统
Centos6.5DVD
大小:
4G
openstack操作系统
Centos6.5Mini
3系统架构图
3.1物理结构图
3.2逻辑结构图
3.3openstack安装
使用赵子顾的自动部署,3节点部署。
3.4ceph安装
3.4.1ip规划
角色
Ip
配置
说明
controller
192.168.1.140
见自动部署说明
虚拟机,cinder、glance、nova-api
network
192.168.1.141
见自动部署说明
虚拟机,neutron
compute
192.168.1.142
见自动部署说明
虚拟机,nova-computer
Cephnode1
192.168.1.148
/dev/sdb
/dev/sdc
虚拟机,deploy,mon,osd
Cephnode2
192.168.1.149
/dev/sdb
/dev/sdc
虚拟机,deploy,mon,osd
Cephnode3
192.168.1.150
/dev/sdb
/dev/sdc
虚拟机,deploy,mon,osd
3.4.2安装步骤
1.修改3台机器的主机名分别为:
ceph148、ceph149、ceph150
2.编辑3台机器/etc/hosts内容如下:
192.168.1.148ceph148
192.168.1.149ceph149
192.168.1.150ceph150
3.将ceph.zip目录拷贝到/home/ceph目录下并且解压,生成ceph和deploy两个目录。
4.编辑/etc/yum.repos.d/ceph.repo文件内容如下:
[ceph-noarch]
name=Cephnoarchpackages
baseurl=file:
///home/ceph/ceph
enabled=1
gpgcheck=0
[ceph-deply]
name=Cephdeploypackages
baseurl=file:
///home/ceph/deploy
enabled=1
gpgcheck=0
5.三个节点增加相互信任:
ceph148上执行:
ssh-keygen
ssh-copy-idceph148
ssh-copy-idceph149
ssh-copy-idceph150
ceph149上执行:
ssh-keygen
ssh-copy-idceph148
ssh-copy-idceph150
ceph150上执行:
ssh-keygen
ssh-copy-idceph148
ssh-copy-idceph149
6.三个节点均关闭selinux和防火墙:
serviceiptablesstop
chkconfigiptablesoff
将/etc/sysconfig/selinux中SELINUX=enforcing改为SELINUX=disabled
重启机器reboot
7.安装ceph,三台机器均执行如下命令:
yuminstallceph-y
8.在ceph148上执行如下命令安装ceph-deploy:
yuminstallceph-deploy-y
9.执行如下命令:
cd/etc/ceph
ceph-deploynewceph148ceph149ceph150
10.部署mon节点,执行如下命令:
ceph-deploymoncreateceph148ceph149ceph150
ceph-deploygatherkeysceph148//收集密钥
11.部署osd节点,执行如下命令:
ceph-deployosdprepareceph148:
/dev/sdbceph148:
/dev/sdcceph149:
/dev/sdbceph149:
/dev/sdcceph150:
/dev/sdbceph150:
/dev/sdc
12.如果有需要,部署mds,执行如下命令:
ceph-deploymdscreateceph148ceph149ceph150
13.重启服务
/etc/init.d/ceph-arestart
14.查看ceph状态是否正常:
ceph-s
显示如下:
cluster4fa8cb32-fea1-4d68-a341-ebddab2f3e0f
healthHEALTH_WARNclockskewdetectedonmon.ceph150
monmape2:
3monsat{ceph148=192.168.1.148:
6789/0,ceph149=192.168.1.149:
6789/0,ceph150=192.168.1.150:
6789/0},electionepoch8,quorum0,1,2ceph148,ceph149,ceph150
osdmape41:
6osds:
6up,6in
pgmapv76:
192pgs,3pools,0bytesdata,0objects
215MBused,91878MB/92093MBavail
192active+clean
15.配置148为ntp的server,其他节点定时向148同步时间
3.5controller节点和compute节点安ceph客户端(不需要,在openstack上执行ceph--version能看到版本表示ceph已经安装)
1.执行如下命令
rpm--import'
rpm--import'
2.增加如下文件:
vi/etc/yum.repos.d/ceph-extras
内容如下:
[ceph-extras]
name=CephExtrasPackages
baseurl=
enabled=1
priority=2
gpgcheck=1
type=rpm-md
gpgkey=
[ceph-extras-noarch]
name=CephExtrasnoarch
baseurl=
enabled=1
priority=2
gpgcheck=1
type=rpm-md
gpgkey=
[ceph-extras-source]
name=CephExtrasSources
baseurl=
enabled=1
priority=2
gpgcheck=1
type=rpm-md
gpgkey=
3.添加ceph库
rpm-Uvh
4.添加epel库
rpm-Uvhhttp:
//dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
5.安装ceph
yumupdate-y
yuminstallceph-y
3.6controller节点配置glance使用ceph
1.将ceph148节点/etc/ceph目录下的两个文件拷贝到controller节点和compute节点
cd/etc/ceph/
scpceph.confceph.client.admin.keyring192.168.1.142:
/etc/ceph/
scpceph.confceph.client.admin.keyring192.168.1.140:
/etc/ceph/
2.修改ceph.client.admin.keyring的权限
chmod+r/etc/ceph/ceph.client.admin.keyring
3.在ceph148上创建glance的存储池
radosmkpoolglance
4.编辑140上glance的配置文件/etc/glance/glance-api.conf中如下配置项
rbd_store_ceph_conf=/etc/ceph/ceph.conf
default_store=rbd
rbd_store_user=admin
rbd_store_pool=glance
5.重启glance-api进程
/etc/init.d/openstack-glance-apirestart
6.测试上传本地镜像,首先将测试镜像cirros-0.3.2-x86_64-disk.img放到140的/home/,然后执行如下上传命令:
glanceimage-create--name"cirros-0.3.2-x86_64-10"--disk-formatqcow2--container-formatbare--is-publicTrue--progress
显示如下:
[=============================>]100%
+------------------+--------------------------------------+
|Property|Value|
+------------------+--------------------------------------+
|checksum|64d7c1cd2b6f60c92c14662941cb7913|
|container_format|bare|
|created_at|2014-09-16T08:
15:
46|
|deleted|False|
|deleted_at|None|
|disk_format|qcow2|
|id|49a71de0-0842-4a7a-b756-edfcb0b86153|
|is_public|True|
|min_disk|0|
|min_ram|0|
|name|cirros-0.3.2-x86_64-10|
|owner|3636a6e92daf4991beb64643bc145fab|
|protected|False|
|size|13167616|
|status|active|
|updated_at|2014-09-16T08:
15:
51|
|virtual_size|None|
+------------------+--------------------------------------+
7.查看上传的镜像
glanceimage-list
显示如下:
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
|ID|Name|DiskFormat|ContainerFormat|Size|Status|
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
|49a71de0-0842-4a7a-b756-edfcb0b86153|cirros-0.3.2-x86_64-10|qcow2|bare|13167616|active|
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
8.测试网页上传镜像,在网页上传一个镜像,然后查看镜像文件
glanceimage-list
显示如下:
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
|ID|Name|DiskFormat|ContainerFormat|Size|Status|
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
|da28a635-2336-4603-a596-30879f4716f4|asdadada|qcow2|bare|13167616|active|
|49a71de0-0842-4a7a-b756-edfcb0b86153|cirros-0.3.2-x86_64-10|qcow2|bare|13167616|active|
+--------------------------------------+------------------------+-------------+------------------+----------+--------+
9.查看ceph中glance池中的对象:
rbdlsglance
显示如下:
49a71de0-0842-4a7a-b756-edfcb0b86153
da28a635-2336-4603-a596-30879f4716f4
3.7controller节点配置cinder使用ceph
1.在ceph148上创建cinder的存储池
radosmkpoolcinder
2.编辑140上cinder的配置文件/etc/cinder/cinder.conf中如下配置项
volume_driver=cinder.volume.drivers.rbd.RBDDriver
rbd_pool=cinder
rbd_user=admin
rbd_ceph_conf=/etc/ceph/ceph.conf
3.重启/etc/init.d/openstack-cinder-volume进程
/etc/init.d/openstack-cinder-volumerestart
4.命令行创建一个1G的磁盘
cindercreate--display-namedev11
显示如下:
cinderlist+---------------------+--------------------------------------+
|Property|Value|
+---------------------+--------------------------------------+
|attachments|[]|
|availability_zone|nova|
|bootable|false|
|created_at|2014-09-16T08:
48:
50.367976|
|display_description|None|
|display_name|dev1|
|encrypted|False|
|id|1d8f3416-fb15-44a9-837f-7724a9034b1e|
|metadata|{}|
|size|1|
|snapshot_id|None|
|source_volid|None|
|status|creating|
|volume_type|None|
+---------------------+--------------------------------------+
5.查看创建的磁盘状态
cinderlist
显示如下:
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
|ID|Status|DisplayName|Size|VolumeType|Bootable|Attachedto|
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
|1d8f3416-fb15-44a9-837f-7724a9034b1e|creating|dev1|1|None|false||
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
界面创建一个2G磁盘
6.查看创建的磁盘状态
cinderlist
显示如下:
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|ID|Status|DisplayName|Size|VolumeType|Bootable|Attachedto|
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|1d8f3416-fb15-44a9-837f-7724a9034b1e|available|dev1|1|None|false||
|e53efe68-5d3b-438d-84c1-fa4c68bd9582|available|dev2|2|None|false||
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
10.查看ceph中cinder池中的对象:
rbdlscinder
显示如下:
volume-1d8f3416-fb15-44a9-837f-7724a9034b1e
volume-e53efe68-5d3b-438d-84c1-fa4c68bd9582
3.8compute节点配置nova使用ceph
1.升级libvirt1.1.0,参考《qemu-libvirt更新步骤.doct》
2.编译qemu-1.6.1,参考《qemu-libvirt更新步骤.doct》
3.在ceph148上创建nova的存储池
radosmkpoolnova
4.生成一个uuid
uuidgen
显示如下:
c245e1ef-d340-4d02-9dcf-fd091cd1fe47
5.执行如下命令
cat>secret.xml< EOF virshsecret-define--filesecret.xml 显示如下: Secretc245e1ef-d340-4d02-9dcf-fd091cd1fe47created 6.执行如下命令: cat/etc/ceph/ceph.client.admin.keyring 显示如下: [client.admin] key=AQAXrRdU8O7uHRAAvYit51h4Dgiz6jkAtq8GLA== 7.将“AQAXrRdU8O7uHRAAvYit51h4Dgiz6jkAtq8GLA==”放到一个临时文件 echo"AQAXrRdU8O7uHRAAvYit51h4Dgiz6jkAtq8GLA==">key 8.执行如下命令: virshsecret-set-value--secretc245e1ef-d340-4d02-9dcf-fd091cd1fe47--base64$(catkey) 9.编辑142上nova的配置文件/etc/nova/nova.conf中如下配置项 images_type=rbd imag
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- openstack ceph 整合 安装 指导 文档