查看网卡
1 | ip link |
修改网卡配置
- 修改配置文件ifcfg-{网卡名称}
eg: /etc/sysconfig/network-scripts/ifcfg-eno16777736
1 | ONBOOT=yes |
- 修改resolv.conf
eg: /etc/resolv.conf1
2nameserver 202.96.64.68
nameserver 8.8.8.8
重启network服务
重启network服务1
service network restart
1 | ip link |
1 | ONBOOT=yes |
1 | nameserver 202.96.64.68 |
重启network服务1
service network restart
1 | modprobe rbd |
如果你在执行echo
时候提示参数错误,请现查看modinfo rbd
看看里面的single_major
默认值是否为false
eg:1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17$ modinfo rbd
filename: /lib/modules/3.10.0-693.el7.x86_64/kernel/drivers/block/rbd.ko.xz
license: GPL
description: RADOS Block Device (RBD) driver
author: Jeff Garzik <jeff@garzik.org>
author: Yehuda Sadeh <yehuda@hq.newdream.net>
author: Sage Weil <sage@newdream.net>
author: Alex Elder <elder@inktank.com>
rhelversion: 7.4
srcversion: B41E51769EC95E3DBDB16AB
depends: libceph
intree: Y
vermagic: 3.10.0-693.el7.x86_64 SMP mod_unload modversions
signer: CentOS Linux kernel signing key
sig_key: DA:18:7D:CA:7D:BE:53:AB:05:BD:13:BD:0C:4E:21:F4:22:B6:A4:9C
sig_hashalgo: sha256
parm: single_major:Use a single major number for all rbd devices (default: false) (bool)
如果single_major
默认值为ture
,那么在加载rbd模块时,需要将single_major
设置成false
eg:1
modprobe rbd single_major=0
然后在重新执行echo
。
ceph 分布式统一存储
1 | yum localinstall *.rpm |
1 |
|
ceph集群包括两类节点,mon节点、OSD节点
1 |
|
http://docs.ceph.com/docs/jewel/rados/configuration/osd-config-ref/
http://docs.ceph.com/docs/jewel/rados/configuration/filesystem-recommendations/
详细请见:http://docs.ceph.com/docs/jewel/rados/configuration/network-config-ref/
创建ceph专属用户——ceph
1 | useradd -Um -d /home/ceph ceph |
1 | sudo yum localinstall *.rpm |
详细请见:http://docs.ceph.com/docs/jewel/install/manual-deployment/
注意:
1 | systemctl enable ceph-mon@{MON ID} |
大括号中的内容需要根据实际情况填写。
一个华丽的分割之后开始漫长的优化之路
详细请见:
《OSD节点优化》、《Ceph集群OSD节点配置优化》
配置文件 ”~/.gitconfig“
1 | [user] |
1 | # 状态栏 |
RHEL从7.1版本(包含7.1)将libceph.ko、ceph.ko、rbd.ko纳入到kernel中,所以如果选择7.1之前的版本需要自己编译相关ko文件
步骤:
卸载RHEL yum包
1 | rpm -qa | grep yum | xargs -e --nodeps |
安装CentOS yum包
下载yum包
1 | wget http://mirrors.163.com/centos/7.2.1511/os/x86_64/Packages/yum-3.4.3-132.el7.centos.0.1.noarch.rpm |
安装yum包1
rpm -ivh *.rpm
在“/etc/yum.repo.d/”目录下,增加文件rhel7.repo,内容如下。1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24[base]
name=CentOS-$releasever - Base
baseurl=http://mirrors.163.com/centos/7.2.1511/os/$basearch/
gpgcheck=1
gpgkey=http://mirrors.163.com/centos/7.2.1511/os/x86_64/RPM-GPG-KEY-CentOS-7
#released updates
[updates]
name=CentOS-$releasever - Updates
baseurl=http://mirrors.163.com/centos/7.2.1511/updates/$basearch/
gpgcheck=1
gpgkey=http://mirrors.163.com/centos/7.2.1511/os/x86_64/RPM-GPG-KEY-CentOS-7
[extras]
name=CentOS-$releasever - Extras
baseurl=http://mirrors.163.com/centos/7.2.1511/extras//$basearch/
gpgcheck=1
gpgkey=http://mirrors.163.com/centos/7.2.1511/os/x86_64/RPM-GPG-KEY-CentOS-7
[centosplus]
name=CentOS-$releasever - Plus
baseurl=http://mirrors.163.com/centos/7.2.1511/centosplus//$basearch/
gpgcheck=1
enabled=0k
在“/etc/yum.repo.d/”目录下,增加文件ceph.repo,内容如下。1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26[ceph]
name=Ceph packages for $basearch
baseurl=http://ceph.com/rpm-infernalis/el7/$basearch
enabled=1
priority=2
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc
[ceph-noarch]
name=Ceph noarch packages
baseurl=http://ceph.com/rpm-infernalis/el7/noarch
enabled=1
priority=2
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc
[ceph-source]
name=Ceph source packages
baseurl=http://ceph.com/rpm-infernalis/el7/SRPMS
enabled=0
priority=2
gpgcheck=1
type=rpm-md
gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc
1 | yum install --downloadonly ceph-common --downloaddir=./ |
进入rpm包所在目录1
yum localinstall *.rpm
1 | yum install {软件名称} |
1 | yum search {关键字s} |
1 | yum install --downloadonly {需要下载的软件名,可多个} --downloaddir={下载位置,目录名} |
1 | yum localinstall *.rpm |
1 | yum list {安装包名称} --showduplicates |
1 | yum install {安装包名称}-<VERSION_STRING> |
eg: yum install ceph-13.2.6-0.el7
1 | rpm -ivh {xxx.rpm} |
1 | rpm -e --nodeps {软件名称} |
1 | rpm2cpio {xxx.rpm} | cpio -div |
1 | rpm -qpR {软件名称} |
ceph 版本分类包括“开发版”、“稳定版(Stable)”、“长期支持版(LTS)”;
以下列出稳定版和长期支持版本及对应的版本号:
版本名称 | 分类 | 版本号 |
---|---|---|
argonaut | Stable | v0.48 ~ v0.48.3 |
bobtail | Stable | v0.56 ~ v0.56.7 |
Cuttlefish | Stable | v0.61 ~ v0.61.9 |
Dumpling | LTS | v0.67 ~ v0.67.12 |
Emperor | Stable | v0.72 ~ v0.72.3 |
Firefly | LTS | v0.80 ~ v0.80.11 |
Giant | Stable | v0.87 ~ v0.87.2 |
Hammer | LTS | v0.94 ~ v0.94.6 |
Infernalis | Stable | v9.2.0 ~ v9.2.1 |
Jewel | Stable or LTS | v10.2.0(未发布) |
综上所述,可供选择的版本有Hammer 、 Infernalis 和 Jewel
ceph的运行平台众多,包括:CentOS(RHEL)、Debian、Ubuntu、Fedora
CentOS(RHEL)
Hammer | Infernalis | |
---|---|---|
启始日期 | 2015.04 | 2015.11 |
终止日期 | 2016.11 | 2016.06 |
原因:
1 | -+- +-------------------+ |