1、简介
mon 操作 我还真是比较少，关于 mon 添加删除 操作 我反正 从来 没有 在线上环境执行过；哈哈哈，为了以备 不时之需，还是 练练手 了解下（有备无患 嘛）；本文先 基于 ceph-deploy 工具 操作（手动的 反正 我也试过了 -- 没难度，有兴趣的 可以 自己 手动 尝试下，需要的话 留言 后期 补上 手动 操作文档）
1.1 操作系统
## 本文操作系统 Ubuntu 16.04 amd64
# lsb_release -a
1.2 ceph 版本
ceph Luminous 12.2.5
2、删除 mon
为什么 先来 删除 mon，因为 我得 环境 刚好 部署了 三个 mon，先删除 两个 mon
2.1 删除
# ceph-deploy --username cstor mon destroy mon2
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cstor/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (1.5.39): /usr/bin/ceph-deploy --username cstor mon destroy mon2
[ceph_deploy.cli][INFO ] ceph-deploy options:
[ceph_deploy.cli][INFO ] username : cstor
[ceph_deploy.cli][INFO ] verbose : False
[ceph_deploy.cli][INFO ] overwrite_conf : False
[ceph_deploy.cli][INFO ] subcommand : destroy
[ceph_deploy.cli][INFO ] quiet : False
[ceph_deploy.cli][INFO ] cd_conf :
[ceph_deploy.cli][INFO ] cluster : ceph
[ceph_deploy.cli][INFO ] mon : ['mon2']
[ceph_deploy.cli][INFO ] func :
[ceph_deploy.cli][INFO ] ceph_conf : None
[ceph_deploy.cli][INFO ] default_release : False
[ceph_deploy.mon][DEBUG ] Removing mon from mon2
cstor@mon2's password:
[mon2][DEBUG ] connection detected need for sudo
cstor@mon2's password:
[mon2][DEBUG ] connected to host: cstor@mon2
[mon2][DEBUG ] detect platform information from remote host
[mon2][DEBUG ] detect machine type
[mon2][DEBUG ] find the location of an executable
[mon2][DEBUG ] get remote short hostname
[mon2][INFO ] Running command: sudo ceph --cluster=ceph -n mon. -k /var/lib/ceph/mon/ceph-mon2/keyring mon remove mon2
[mon2][WARNIN] removing mon.mon2 at XXX.XXX.XXX.XXX:6789/0, there will be 2 monitors
[mon2][INFO ] polling the daemon to verify it stopped
[mon2][INFO ] Running command: sudo systemctl stop [email protected]
[mon2][INFO ] Running command: sudo mkdir -p /var/lib/ceph/mon-removed
[mon2][DEBUG ] move old monitor data
2.2 配置 修改
我也不知道 不修改 配置 会不会 有什么 影响（最好还是 修改一下吧）-- mon_initial_members、mon_host 这两个参数（修改 集群 中 所有得配置 -- 虽然麻烦，但是 还需要操作哦）
# cat /etc/ceph/ceph.conf
... ...
mon_initial_members = mon0, mon1
mon_host = XXX.XXX.XXX.XXX,XXX.XXX.XXX.XXX
... ...
3、添加 mon
哈哈哈，删除 mon 之后，现在 开始 添加 mon （开始埋坑）
3.1 配置修改
## 修改配置文件时，需要 将集群 得配置文件 统一
# cat /etc/ceph/ceph.conf
... ...
mon_initial_members = mon0, mon1,mon2
mon_host = XXX.XXX.XXX.XXX,XXX.XXX.XXX.XXX,XXX.XXX.XXX.XXX
... ...
3.2 添加 mon
# ceph-deploy --username cstor mon create mon2
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cstor/.cephdeploy.conf
[ceph_deploy.cli][INFO ] Invoked (1.5.39): /usr/bin/ceph-deploy --username cstor mon create mon2
[ceph_deploy.cli][INFO ] ceph-deploy options:
[ceph_deploy.cli][INFO ] username : cstor
[ceph_deploy.cli][INFO ] verbose : False
[ceph_deploy.cli][INFO ] overwrite_conf : False
[ceph_deploy.cli][INFO ] subcommand : create
[ceph_deploy.cli][INFO ] quiet : False
[ceph_deploy.cli][INFO ] cd_conf :
[ceph_deploy.cli][INFO ] cluster : ceph
[ceph_deploy.cli][INFO ] mon : ['mon2']
[ceph_deploy.cli][INFO ] func :
[ceph_deploy.cli][INFO ] ceph_conf : None
[ceph_deploy.cli][INFO ] keyrings : None
[ceph_deploy.cli][INFO ] default_release : False
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts mon2
[ceph_deploy.mon][DEBUG ] detecting platform for host mon2 ...
cstor@mon2's password:
[mon2][DEBUG ] connection detected need for sudo
cstor@mon2's password:
[mon2][DEBUG ] connected to host: cstor@mon2
[mon2][DEBUG ] detect platform information from remote host
[mon2][DEBUG ] detect machine type
[mon2][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO ] distro info: Ubuntu 16.04 xenial
[mon2][DEBUG ] determining if provided host has same hostname in remote
[mon2][DEBUG ] get remote short hostname
[mon2][DEBUG ] deploying mon to mon2
[mon2][DEBUG ] get remote short hostname
[mon2][DEBUG ] remote hostname: mon2
[mon2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[mon2][DEBUG ] create the mon path if it does not exist
[mon2][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-mon2/done
[mon2][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-mon2/done
[mon2][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-mon2.mon.keyring
[mon2][DEBUG ] create the monitor keyring file
[mon2][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i mon2 --keyring /var/lib/ceph/tmp/ceph-mon2.mon.keyring --setuser 64045 --setgroup 64045
[mon2][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-mon2.mon.keyring
[mon2][DEBUG ] create a done file to avoid re-doing the mon deployment
[mon2][DEBUG ] create the init path if it does not exist
[mon2][INFO ] Running command: sudo systemctl enable ceph.target
[mon2][INFO ] Running command: sudo systemctl enable ceph-mon@mon2
[mon2][INFO ] Running command: sudo systemctl start ceph-mon@mon2
[mon2][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.mon2.asok mon_status
[mon2][DEBUG ] ********************************************************************************
[mon2][DEBUG ] status for monitor: mon.mon2
[mon2][DEBUG ] {
[mon2][DEBUG ] "election_epoch": 0,
[mon2][DEBUG ] "extra_probe_peers": [
[mon2][DEBUG ] "XXX.XXX.XXX.XXX:6789/0",
[mon2][DEBUG ] "XXX.XXX.XXX.XXX:6789/0"
[mon2][DEBUG ] ],
[mon2][DEBUG ] "feature_map": {
[mon2][DEBUG ] "mon": {
[mon2][DEBUG ] "group": {
[mon2][DEBUG ] "features": "0x1ffddff8eea4fffb",
[mon2][DEBUG ] "num": 1,
[mon2][DEBUG ] "release": "luminous"
[mon2][DEBUG ] }
[mon2][DEBUG ] }
[mon2][DEBUG ] },
[mon2][DEBUG ] "features": {
[mon2][DEBUG ] "quorum_con": "0",
[mon2][DEBUG ] "quorum_mon": [],
[mon2][DEBUG ] "required_con": "0",
[mon2][DEBUG ] "required_mon": [
[mon2][DEBUG ] "kraken",
[mon2][DEBUG ] "luminous"
[mon2][DEBUG ] ]
[mon2][DEBUG ] },
[mon2][DEBUG ] "monmap": {
[mon2][DEBUG ] "created": "2019-01-04 15:43:39.644529",
[mon2][DEBUG ] "epoch": 3,
[mon2][DEBUG ] "features": {
[mon2][DEBUG ] "optional": [],
[mon2][DEBUG ] "persistent": [
[mon2][DEBUG ] "kraken",
[mon2][DEBUG ] "luminous"
[mon2][DEBUG ] ]
[mon2][DEBUG ] },
[mon2][DEBUG ] "fsid": "79fabbdf-b031-4621-952a-3fe880068501",
[mon2][DEBUG ] "modified": "2019-02-22 15:47:19.502869",
[mon2][DEBUG ] "mons": [
[mon2][DEBUG ] {
[mon2][DEBUG ] "addr": "XXX.XXX.XXX.XXX:6789/0",
[mon2][DEBUG ] "name": "mon0",
[mon2][DEBUG ] "public_addr": "XXX.XXX.XXX.XXX:6789/0",
[mon2][DEBUG ] "rank": 0
[mon2][DEBUG ] }
[mon2][DEBUG ] ]
[mon2][DEBUG ] },
[mon2][DEBUG ] "name": "mon2",
[mon2][DEBUG ] "outside_quorum": [],
[mon2][DEBUG ] "quorum": [],
[mon2][DEBUG ] "rank": -1,
[mon2][DEBUG ] "state": "probing",
[mon2][DEBUG ] "sync_provider": []
[mon2][DEBUG ] }
[mon2][DEBUG ] ********************************************************************************
[mon2][INFO ] monitor: mon.mon2 is currently at the state of probing
[mon2][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.mon2.asok mon_status
[mon2][WARNIN] monitor mon2 does not exist in monmap
[mon2][WARNIN] neither `public_addr` nor `public_network` keys are defined for monitors
[mon2][WARNIN] monitors may not be able to form quorum
4、mon 状态 查询
# ceph -s
# ceph quorum_status [--format json-pretty]
# ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.{mon_name}.asok mon_status