dianxiaji9211

分布式存储ceph集群实践

1、环境规划，三台主机

10.213.14.51/24 10.213.14.52/24 10.213.14.53/24 集群网络

172.140.140.11、22 172.140.140.12/22 172.140.140.13/22 复制网络

centos7.3 ceph版本 luminous 12.2.4 ceph-deploy 2.0.0

2、ceph体系架构

3、ceph核心概念

Monitors: A Ceph Monitor (ceph-mon) maintains maps of the cluster state, including the monitor map, manager map, the OSD map, and the CRUSH map. These maps are critical cluster state required for Ceph daemons to coordinate with each other. Monitors are also responsible for managing authentication between daemons and clients. At least three monitors are normally required for redundancy and high availability.
Managers: A Ceph Manager daemon (ceph-mgr) is responsible for keeping track of runtime metrics and the current state of the Ceph cluster, including storage utilization, current performance metrics, and system load. The Ceph Manager daemons also host python-based plugins to manage and expose Ceph cluster information, including a web-based dashboard and REST API. At least two managers are normally required for high availability.

该组件的主要作用是分担和扩展monitor的部分功能，减轻monitor的负担，让更好地管理ceph存储系统

Ceph OSDs: A Ceph OSD (object storage daemon, ceph-osd) stores data, handles data replication, recovery, rebalancing, and provides some monitoring information to Ceph Monitors and Managers by checking other Ceph OSD Daemons for a heartbeat. At least 3 Ceph OSDs are normally required for redundancy and high availability.
MDSs: A Ceph Metadata Server (MDS, ceph-mds) stores metadata on behalf of the Ceph Filesystem (i.e., Ceph Block Devices and Ceph Object Storage do not use MDS). Ceph Metadata Servers allow POSIX file system users to execute basic commands (like ls, find, etc.) without placing an enormous burden on the Ceph Storage Cluster.

4、预备工作

hostnamectl set-hostname ceph-1

cat /etc/hosts
10.213.14.51  ceph-1
10.213.14.52  ceph-2
10.213.14.53  ceph-3

yum install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm  （每台都需要）
yum install ceph-deploy ntp ntpdate ntp-doc –y  (ceph-deploy  ceph工具只需在一台上面部署即可)

systemctl start ntpd
systemctl enable ntpd

免秘钥登录

[root@ceph-1 ceph]# cat /etc/yum.repos.d/ceph.repo
[ceph]
name=Ceph packages for $basearch
baseurl=https://download.ceph.com/rpm-luminous/el7/$basearch
enabled=1
gpgcheck=1
priority=1
type=rpm-md
gpgkey=https://download.ceph.com/keys/release.asc

[ceph-noarch]
name=Ceph noarch packages
baseurl=https://download.ceph.com/rpm-luminous/el7/noarch
enabled=1
gpgcheck=1
priority=1
type=rpm-md
gpgkey=https://download.ceph.com/keys/release.asc

[ceph-source]
name=Ceph source packages
baseurl=https://download.ceph.com/rpm-luminous/el7/SRPMS
enabled=0
gpgcheck=1
type=rpm-md
gpgkey=https://download.ceph.com/keys/release.asc
priority=1

export CEPH_DEPLOY_REPO_URL=https://download.ceph.com/rpm-luminous/el7/
export CEPH_DEPLOY_GPG_URL=https://download.ceph.com/keys/release.asc

5、ceph集群部署

创建工作目录
mkdir -p /root /ceph && cd /root/ceph

ceph-deploy new ceph-{1,2,3}
[root@ceph-1 ceph]# export CEPH_DEPLOY_REPO_URL=http://mirrors.163.com/ceph/rpm-luminous/el7
[root@ceph-1 ceph]# export CEPH_DEPLOY_GPG_URL=http://mirrors.163.com/ceph/keys/release.asc
[root@ceph-1 ceph]# ceph-deploy new ceph-{1,2,3}
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.0.0): /bin/ceph-deploy new ceph-1 ceph-2 ceph-3
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  func                          : <function new at 0x23eaaa0>
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : 0x244f320>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  ssh_copykey                   : True
[ceph_deploy.cli][INFO  ]  mon                           : ['ceph-1', 'ceph-2', 'ceph-3']
[ceph_deploy.cli][INFO  ]  public_network                : None
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  cluster_network               : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  fsid                          : None
[ceph_deploy.new][DEBUG ] Creating new cluster named ceph
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[ceph-1][DEBUG ] connected to host: ceph-1 
[ceph-1][DEBUG ] detect platform information from remote host
[ceph-1][DEBUG ] detect machine type
[ceph-1][DEBUG ] find the location of an executable
[ceph-1][INFO  ] Running command: /usr/sbin/ip link show
[ceph-1][INFO  ] Running command: /usr/sbin/ip addr show
[ceph-1][DEBUG ] IP addresses found: [u'10.213.14.51', u'172.17.0.1', u'172.140.140.11', u'10.50.50.13']
[ceph_deploy.new][DEBUG ] Resolving host ceph-1
[ceph_deploy.new][DEBUG ] Monitor ceph-1 at 10.213.14.51
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[ceph-2][DEBUG ] connected to host: ceph-1 
[ceph-2][INFO  ] Running command: ssh -CT -o BatchMode=yes ceph-2
[ceph-2][DEBUG ] connected to host: ceph-2 
[ceph-2][DEBUG ] detect platform information from remote host
[ceph-2][DEBUG ] detect machine type
[ceph-2][DEBUG ] find the location of an executable
[ceph-2][INFO  ] Running command: /usr/sbin/ip link show
[ceph-2][INFO  ] Running command: /usr/sbin/ip addr show
[ceph-2][DEBUG ] IP addresses found: [u'10.213.14.52', u'172.17.0.1', u'172.140.140.13', u'10.50.50.12']
[ceph_deploy.new][DEBUG ] Resolving host ceph-2
[ceph_deploy.new][DEBUG ] Monitor ceph-2 at 10.213.14.52
[ceph_deploy.new][INFO  ] making sure passwordless SSH succeeds
[ceph-3][DEBUG ] connected to host: ceph-1 
[ceph-3][INFO  ] Running command: ssh -CT -o BatchMode=yes ceph-3
[ceph-3][DEBUG ] connected to host: ceph-3 
[ceph-3][DEBUG ] detect platform information from remote host
[ceph-3][DEBUG ] detect machine type
[ceph-3][DEBUG ] find the location of an executable
[ceph-3][INFO  ] Running command: /usr/sbin/ip link show
[ceph-3][INFO  ] Running command: /usr/sbin/ip addr show
[ceph-3][DEBUG ] IP addresses found: [u'172.140.140.15', u'172.17.0.1', u'10.213.14.53']
[ceph_deploy.new][DEBUG ] Resolving host ceph-3
[ceph_deploy.new][DEBUG ] Monitor ceph-3 at 10.213.14.53
[ceph_deploy.new][DEBUG ] Monitor initial members are ['ceph-1', 'ceph-2', 'ceph-3']
[ceph_deploy.new][DEBUG ] Monitor addrs are ['10.213.14.51', '10.213.14.52', '10.213.14.53']
[ceph_deploy.new][DEBUG ] Creating a random mon key...
[ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring...
[ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf...


[root@ceph-1 ceph]# ll
total 20
-rw-r--r-- 1 root root   238 Apr 17 11:07 ceph.conf
-rw-r--r-- 1 root root 10605 Apr 17 11:07 ceph-deploy-ceph.log
-rw------- 1 root root    73 Apr 17 11:07 ceph.mon.keyring

Vim ceph.conf
public network = 10.213.14.0/24  设置集群网络，对外提供服务
cluster network = 172.140.140.0/22设置复制网络，集群内部通信


安装ceph软件包

安装ceph软件包

[root@ceph-1 ceph]# ceph-deploy install ceph-1 ceph-2 ceph-3

[root@ceph-1 ceph]# ceph-deploy install ceph-1 ceph-2 ceph-3 #部分输出信息如下

[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf

[ceph_deploy.cli][INFO ] Invoked (2.0.0): /usr/bin/ceph-deploy install ceph-1 ceph-2 ceph-3

[ceph_deploy.cli][INFO ] ceph-deploy options:

[ceph_deploy.cli][INFO ] verbose : False

[ceph_deploy.cli][INFO ] testing : None

[ceph_deploy.cli][INFO ] cd_conf :

[ceph_deploy.cli][INFO ] cluster : ceph

[ceph_deploy.cli][INFO ] dev_commit : None

[ceph_deploy.cli][INFO ] install_mds : False

[ceph_deploy.cli][INFO ] stable : None

[ceph_deploy.cli][INFO ] default_release : False

[ceph_deploy.cli][INFO ] username : None

[ceph_deploy.cli][INFO ] adjust_repos : True

[ceph_deploy.cli][INFO ] func :

[ceph_deploy.cli][INFO ] install_mgr : False

[ceph_deploy.cli][INFO ] install_all : False

[ceph_deploy.cli][INFO ] repo : False

[ceph_deploy.cli][INFO ] host : ['ceph-1', 'ceph-2', 'ceph-3']

[ceph_deploy.cli][INFO ] install_rgw : False

[ceph_deploy.cli][INFO ] install_tests : False

[ceph_deploy.cli][INFO ] repo_url : None

[ceph_deploy.cli][INFO ] ceph_conf : None

[ceph_deploy.cli][INFO ] install_osd : False

[ceph_deploy.cli][INFO ] version_kind : stable

[ceph_deploy.cli][INFO ] install_common : False

[ceph_deploy.cli][INFO ] overwrite_conf : False

[ceph_deploy.cli][INFO ] quiet : False

[ceph_deploy.cli][INFO ] dev : master

[ceph_deploy.cli][INFO ] nogpgcheck : False

[ceph_deploy.cli][INFO ] local_mirror : None

[ceph_deploy.cli][INFO ] release : None

[ceph_deploy.cli][INFO ] install_mon : False

[ceph_deploy.cli][INFO ] gpg_url : None

[ceph_deploy.install][DEBUG ] Installing stable version jewel on cluster ceph hosts ceph-1 ceph-2 ceph-3

[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-1 ...

[ceph-1][DEBUG ] connected to host: ceph-1

[ceph-1][DEBUG ] detect platform information from remote host

[ceph-1][DEBUG ] detect machine type

[ceph_deploy.install][INFO ] Distro info: CentOS Linux 7.3.1611 Core

[ceph-1][INFO ] installing Ceph on ceph-1

[ceph-1][INFO ] using custom repository location: https://download.ceph.com/rpm-luminous/el7/

[ceph-1][INFO ] Running command: yum clean all

[ceph-1][DEBUG ] Loaded plugins: fastestmirror, priorities

[ceph-1][DEBUG ] Cleaning repos: base ceph ceph-noarch epel extras updates

[ceph-1][DEBUG ] Cleaning up everything

[ceph-1][DEBUG ] Cleaning up list of fastest mirrors

[ceph-1][INFO ] Running command: rpm --import https://download.ceph.com/keys/release.asc

[ceph-1][DEBUG ] add yum repo file in /etc/yum.repos.d/

[ceph-1][INFO ] Running command: yum -y install yum-plugin-priorities

[ceph-1][DEBUG ] Loaded plugins: fastestmirror, priorities

ceph-2][DEBUG ] Replaced:

[ceph-2][DEBUG ] libcephfs1.x86_64 1:10.2.10-0.el7 rdma.noarch 0:7.3_4.7_rc2-5.el7

[ceph-2][DEBUG ]

[ceph-2][DEBUG ] Complete!

[ceph-2][INFO ] Running command: ceph --version

[ceph-2][DEBUG ] ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)

[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-3 ...

[ceph-3][DEBUG ] connected to host: ceph-3

[ceph-3][DEBUG ] detect platform information from remote host

[ceph-3][DEBUG ] detect machine type

[ceph_deploy.install][INFO ] Distro info: CentOS Linux 7.3.1611 Core

[ceph-3][INFO ] installing Ceph on ceph-3

[ceph-3][INFO ] using custom repository location: https://download.ceph.com/rpm-luminous/el7/

[ceph-3][INFO ] Running command: yum clean all

[ceph-3][DEBUG ] Loaded plugins: fastestmirror, priorities

[ceph-3][DEBUG ] Cleaning repos: base epel extras updates

[ceph-3][DEBUG ] Cleaning up everything

[ceph-3][INFO ] Running command: rpm --import https://download.ceph.com/keys/release.asc

[ceph-3][DEBUG ] add yum repo file in /etc/yum.repos.d/

[ceph-3][INFO ] Running command: yum -y install yum-plugin-priorities

[ceph-3][DEBUG ] Loaded plugins: fastestmirror, priorities

[ceph-3][DEBUG ] Dependencies Resolved

[ceph-3][DEBUG ]

[ceph-3][DEBUG ] ================================================================================

[ceph-3][DEBUG ] Package Arch Version Repository Size

[ceph-3][DEBUG ] ================================================================================

[ceph-3][DEBUG ] Installing:

[ceph-3][DEBUG ] ceph x86_64 2:12.2.4-0.el7 ceph 3.0 k

[ceph-3][DEBUG ] ceph-radosgw x86_64 2:12.2.4-0.el7 ceph 3.7 M

[ceph-3][DEBUG ] Installing for dependencies:

[ceph-3][DEBUG ] ceph-base x86_64 2:12.2.4-0.el7 ceph 3.9 M

[ceph-3][DEBUG ] ceph-common x86_64 2:12.2.4-0.el7 ceph 15 M

[ceph-3][DEBUG ] ceph-mds x86_64 2:12.2.4-0.el7 ceph 3.5 M

[ceph-3][DEBUG ] ceph-mgr x86_64 2:12.2.4-0.el7 ceph 3.6 M

[ceph-3][DEBUG ] ceph-mon x86_64 2:12.2.4-0.el7 ceph 5.0 M

[ceph-3][DEBUG ] ceph-osd x86_64 2:12.2.4-0.el7 ceph 13 M

[ceph-3][DEBUG ] ceph-selinux x86_64 2:12.2.4-0.el7 ceph 20 k

[ceph-3][DEBUG ]

[ceph-3][DEBUG ] Transaction Summary

[ceph-3][DEBUG ] ================================================================================

[ceph-3][DEBUG ] Install 2 Packages (+7 Dependent packages)

[ceph-3][DEBUG ]

[ceph-3][DEBUG ] Total download size: 47 M

[ceph-3][DEBUG ] Installed size: 161 M

[ceph-3][DEBUG ] Downloading packages:

[ceph-3][DEBUG ] Installed:

[ceph-3][DEBUG ] ceph.x86_64 2:12.2.4-0.el7 ceph-radosgw.x86_64 2:12.2.4-0.el7

[ceph-3][DEBUG ]

[ceph-3][DEBUG ] Dependency Installed:

[ceph-3][DEBUG ] ceph-base.x86_64 2:12.2.4-0.el7 ceph-common.x86_64 2:12.2.4-0.el7

[ceph-3][DEBUG ] ceph-mds.x86_64 2:12.2.4-0.el7 ceph-mgr.x86_64 2:12.2.4-0.el7

[ceph-3][DEBUG ] ceph-mon.x86_64 2:12.2.4-0.el7 ceph-osd.x86_64 2:12.2.4-0.el7

[ceph-3][DEBUG ] ceph-selinux.x86_64 2:12.2.4-0.el7

[ceph-3][DEBUG ]

[ceph-3][DEBUG ] Complete!

[ceph-3][INFO ] Running command: ceph --version

[ceph-3][DEBUG ] ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)

初始化mon，并生成key

[root@ceph-1 ceph]# ceph-deploy mon create-initial

[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf

[ceph_deploy.cli][INFO ] Invoked (2.0.0): /usr/bin/ceph-deploy mon create-initial

[ceph_deploy.cli][INFO ] ceph-deploy options:

[ceph_deploy.cli][INFO ] username : None

[ceph_deploy.cli][INFO ] verbose : False

[ceph_deploy.cli][INFO ] overwrite_conf : False

[ceph_deploy.cli][INFO ] subcommand : create-initial

[ceph_deploy.cli][INFO ] quiet : False

[ceph_deploy.cli][INFO ] cd_conf :

[ceph_deploy.cli][INFO ] cluster : ceph

[ceph_deploy.cli][INFO ] func :

[ceph_deploy.cli][INFO ] ceph_conf : None

[ceph_deploy.cli][INFO ] default_release : False

[ceph_deploy.cli][INFO ] keyrings : None

[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-1 ceph-2 ceph-3

[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-1 ...

[ceph-1][DEBUG ] connected to host: ceph-1

[ceph-1][DEBUG ] detect platform information from remote host

[ceph-1][DEBUG ] detect machine type

[ceph-1][DEBUG ] find the location of an executable

[ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.3.1611 Core

[ceph-1][DEBUG ] determining if provided host has same hostname in remote

[ceph-1][DEBUG ] get remote short hostname

[ceph-1][DEBUG ] deploying mon to ceph-1

[ceph-1][DEBUG ] get remote short hostname

[ceph-1][DEBUG ] remote hostname: ceph-1

[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf

[ceph-1][DEBUG ] create the mon path if it does not exist

[ceph-1][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-1/done

[ceph-1][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-1/done

[ceph-1][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-1.mon.keyring

[ceph-1][DEBUG ] create the monitor keyring file

[ceph-1][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-1 --keyring /var/lib/ceph/tmp/ceph-ceph-1.mon.keyring --setuser 167 --setgroup 167

[ceph-1][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-1.mon.keyring

[ceph-1][DEBUG ] create a done file to avoid re-doing the mon deployment

[ceph-1][DEBUG ] create the init path if it does not exist

[ceph-1][INFO ] Running command: systemctl enable ceph.target

[ceph-1][INFO ] Running command: systemctl enable ceph-mon@ceph-1

[ceph-1][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/[email protected] to /usr/lib/systemd/system/[email protected].

[ceph-1][INFO ] Running command: systemctl start ceph-mon@ceph-1

[ceph-1][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status

[ceph-1][DEBUG ] ********************************************************************************

[ceph-1][DEBUG ] status for monitor: mon.ceph-1

[ceph-1][DEBUG ] {

[ceph-1][DEBUG ] "election_epoch": 0,

[ceph-1][DEBUG ] "extra_probe_peers": [

[ceph-1][DEBUG ] "10.213.14.52:6789/0",

[ceph-1][DEBUG ] "10.213.14.53:6789/0"

[ceph-1][DEBUG ] ],

[ceph-1][DEBUG ] "feature_map": {

[ceph-1][DEBUG ] "mon": {

[ceph-1][DEBUG ] "group": {

[ceph-1][DEBUG ] "features": "0x1ffddff8eea4fffb",

[ceph-1][DEBUG ] "num": 1,

[ceph-1][DEBUG ] "release": "luminous"

[ceph-1][DEBUG ] }

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] "features": {

[ceph-1][DEBUG ] "quorum_con": "0",

[ceph-1][DEBUG ] "quorum_mon": [],

[ceph-1][DEBUG ] "required_con": "0",

[ceph-1][DEBUG ] "required_mon": []

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] "monmap": {

[ceph-1][DEBUG ] "created": "2018-04-17 21:42:59.721694",

[ceph-1][DEBUG ] "epoch": 0,

[ceph-1][DEBUG ] "features": {

[ceph-1][DEBUG ] "optional": [],

[ceph-1][DEBUG ] "persistent": []

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] "fsid": "2acc281e-dcb1-49d2-abb3-efcec654ae8c",

[ceph-1][DEBUG ] "modified": "2018-04-17 21:42:59.721694",

[ceph-1][DEBUG ] "mons": [

[ceph-1][DEBUG ] {

[ceph-1][DEBUG ] "addr": "10.213.14.51:6789/0",

[ceph-1][DEBUG ] "name": "ceph-1",

[ceph-1][DEBUG ] "public_addr": "10.213.14.51:6789/0",

[ceph-1][DEBUG ] "rank": 0

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] {

[ceph-1][DEBUG ] "addr": "0.0.0.0:0/1",

[ceph-1][DEBUG ] "name": "ceph-2",

[ceph-1][DEBUG ] "public_addr": "0.0.0.0:0/1",

[ceph-1][DEBUG ] "rank": 1

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] {

[ceph-1][DEBUG ] "addr": "0.0.0.0:0/2",

[ceph-1][DEBUG ] "name": "ceph-3",

[ceph-1][DEBUG ] "public_addr": "0.0.0.0:0/2",

[ceph-1][DEBUG ] "rank": 2

[ceph-1][DEBUG ] }

[ceph-1][DEBUG ] ]

[ceph-1][DEBUG ] },

[ceph-1][DEBUG ] "name": "ceph-1",

[ceph-1][DEBUG ] "outside_quorum": [

[ceph-1][DEBUG ] "ceph-1"

[ceph-1][DEBUG ] ],

[ceph-1][DEBUG ] "quorum": [],

[ceph-1][DEBUG ] "rank": 0,

[ceph-1][DEBUG ] "state": "probing",

[ceph-1][DEBUG ] "sync_provider": []

[ceph-1][DEBUG ] }

[ceph-1][DEBUG ] ********************************************************************************

[ceph-1][INFO ] monitor: mon.ceph-1 is running

[ceph-1][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status

[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-2 ...

[ceph-2][DEBUG ] connected to host: ceph-2

[ceph-2][DEBUG ] detect platform information from remote host

[ceph-2][DEBUG ] detect machine type

[ceph-2][DEBUG ] find the location of an executable

[ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.3.1611 Core

[ceph-2][DEBUG ] determining if provided host has same hostname in remote

[ceph-2][DEBUG ] get remote short hostname

[ceph-2][DEBUG ] deploying mon to ceph-2

[ceph-2][DEBUG ] get remote short hostname

[ceph-2][DEBUG ] remote hostname: ceph-2

[ceph-2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf

[ceph-2][DEBUG ] create the mon path if it does not exist

[ceph-2][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-2/done

[ceph-2][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-2/done

[ceph-2][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-2.mon.keyring

[ceph-2][DEBUG ] create the monitor keyring file

[ceph-2][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-2 --keyring /var/lib/ceph/tmp/ceph-ceph-2.mon.keyring --setuser 167 --setgroup 167

[ceph-2][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-2.mon.keyring

[ceph-2][DEBUG ] create a done file to avoid re-doing the mon deployment

[ceph-2][DEBUG ] create the init path if it does not exist

[ceph-2][INFO ] Running command: systemctl enable ceph.target

[ceph-2][INFO ] Running command: systemctl enable ceph-mon@ceph-2

[ceph-2][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/[email protected] to /usr/lib/systemd/system/[email protected].

[ceph-2][INFO ] Running command: systemctl start ceph-mon@ceph-2

[ceph-2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-2.asok mon_status

[ceph-2][DEBUG ] ********************************************************************************

[ceph-2][DEBUG ] status for monitor: mon.ceph-2

[ceph-2][DEBUG ] {

[ceph-2][DEBUG ] "election_epoch": 0,

[ceph-2][DEBUG ] "extra_probe_peers": [

[ceph-2][DEBUG ] "10.213.14.51:6789/0",

[ceph-2][DEBUG ] "10.213.14.53:6789/0"

[ceph-2][DEBUG ] ],

[ceph-2][DEBUG ] "feature_map": {

[ceph-2][DEBUG ] "mon": {

[ceph-2][DEBUG ] "group": {

[ceph-2][DEBUG ] "features": "0x1ffddff8eea4fffb",

[ceph-2][DEBUG ] "num": 1,

[ceph-2][DEBUG ] "release": "luminous"

[ceph-2][DEBUG ] }

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] "features": {

[ceph-2][DEBUG ] "quorum_con": "0",

[ceph-2][DEBUG ] "quorum_mon": [],

[ceph-2][DEBUG ] "required_con": "0",

[ceph-2][DEBUG ] "required_mon": []

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] "monmap": {

[ceph-2][DEBUG ] "created": "2018-04-17 21:43:02.790329",

[ceph-2][DEBUG ] "epoch": 0,

[ceph-2][DEBUG ] "features": {

[ceph-2][DEBUG ] "optional": [],

[ceph-2][DEBUG ] "persistent": []

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] "fsid": "2acc281e-dcb1-49d2-abb3-efcec654ae8c",

[ceph-2][DEBUG ] "modified": "2018-04-17 21:43:02.790329",

[ceph-2][DEBUG ] "mons": [

[ceph-2][DEBUG ] {

[ceph-2][DEBUG ] "addr": "10.213.14.52:6789/0",

[ceph-2][DEBUG ] "name": "ceph-2",

[ceph-2][DEBUG ] "public_addr": "10.213.14.52:6789/0",

[ceph-2][DEBUG ] "rank": 0

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] {

[ceph-2][DEBUG ] "addr": "0.0.0.0:0/1",

[ceph-2][DEBUG ] "name": "ceph-1",

[ceph-2][DEBUG ] "public_addr": "0.0.0.0:0/1",

[ceph-2][DEBUG ] "rank": 1

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] {

[ceph-2][DEBUG ] "addr": "0.0.0.0:0/2",

[ceph-2][DEBUG ] "name": "ceph-3",

[ceph-2][DEBUG ] "public_addr": "0.0.0.0:0/2",

[ceph-2][DEBUG ] "rank": 2

[ceph-2][DEBUG ] }

[ceph-2][DEBUG ] ]

[ceph-2][DEBUG ] },

[ceph-2][DEBUG ] "name": "ceph-2",

[ceph-2][DEBUG ] "outside_quorum": [

[ceph-2][DEBUG ] "ceph-2"

[ceph-2][DEBUG ] ],

[ceph-2][DEBUG ] "quorum": [],

[ceph-2][DEBUG ] "rank": 0,

[ceph-2][DEBUG ] "state": "probing",

[ceph-2][DEBUG ] "sync_provider": []

[ceph-2][DEBUG ] }

[ceph-2][DEBUG ] ********************************************************************************

[ceph-2][INFO ] monitor: mon.ceph-2 is running

[ceph-2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-2.asok mon_status

[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-3 ...

[ceph-3][DEBUG ] connected to host: ceph-3

[ceph-3][DEBUG ] detect platform information from remote host

[ceph-3][DEBUG ] detect machine type

[ceph-3][DEBUG ] find the location of an executable

[ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.3.1611 Core

[ceph-3][DEBUG ] determining if provided host has same hostname in remote

[ceph-3][DEBUG ] get remote short hostname

[ceph-3][DEBUG ] deploying mon to ceph-3

[ceph-3][DEBUG ] get remote short hostname

[ceph-3][DEBUG ] remote hostname: ceph-3

[ceph-3][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf

[ceph-3][DEBUG ] create the mon path if it does not exist

[ceph-3][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-3/done

[ceph-3][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph-3/done

[ceph-3][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph-3.mon.keyring

[ceph-3][DEBUG ] create the monitor keyring file

[ceph-3][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph-3 --keyring /var/lib/ceph/tmp/ceph-ceph-3.mon.keyring --setuser 167 --setgroup 167

[ceph-3][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph-3.mon.keyring

[ceph-3][DEBUG ] create a done file to avoid re-doing the mon deployment

[ceph-3][DEBUG ] create the init path if it does not exist

[ceph-3][INFO ] Running command: systemctl enable ceph.target

[ceph-3][INFO ] Running command: systemctl enable ceph-mon@ceph-3

[ceph-3][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/[email protected] to /usr/lib/systemd/system/[email protected].

[ceph-3][INFO ] Running command: systemctl start ceph-mon@ceph-3

[ceph-3][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-3.asok mon_status

[ceph-3][DEBUG ] ********************************************************************************

[ceph-3][DEBUG ] status for monitor: mon.ceph-3

[ceph-3][DEBUG ] {

[ceph-3][DEBUG ] "election_epoch": 1,

[ceph-3][DEBUG ] "extra_probe_peers": [

[ceph-3][DEBUG ] "10.213.14.51:6789/0",

[ceph-3][DEBUG ] "10.213.14.52:6789/0"

[ceph-3][DEBUG ] ],

[ceph-3][DEBUG ] "feature_map": {

[ceph-3][DEBUG ] "mon": {

[ceph-3][DEBUG ] "group": {

[ceph-3][DEBUG ] "features": "0x1ffddff8eea4fffb",

[ceph-3][DEBUG ] "num": 1,

[ceph-3][DEBUG ] "release": "luminous"

[ceph-3][DEBUG ] }

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] "features": {

[ceph-3][DEBUG ] "quorum_con": "0",

[ceph-3][DEBUG ] "quorum_mon": [],

[ceph-3][DEBUG ] "required_con": "0",

[ceph-3][DEBUG ] "required_mon": []

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] "monmap": {

[ceph-3][DEBUG ] "created": "2018-04-17 21:43:05.838595",

[ceph-3][DEBUG ] "epoch": 0,

[ceph-3][DEBUG ] "features": {

[ceph-3][DEBUG ] "optional": [],

[ceph-3][DEBUG ] "persistent": []

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] "fsid": "2acc281e-dcb1-49d2-abb3-efcec654ae8c",

[ceph-3][DEBUG ] "modified": "2018-04-17 21:43:05.838595",

[ceph-3][DEBUG ] "mons": [

[ceph-3][DEBUG ] {

[ceph-3][DEBUG ] "addr": "10.213.14.51:6789/0",

[ceph-3][DEBUG ] "name": "ceph-1",

[ceph-3][DEBUG ] "public_addr": "10.213.14.51:6789/0",

[ceph-3][DEBUG ] "rank": 0

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] {

[ceph-3][DEBUG ] "addr": "10.213.14.52:6789/0",

[ceph-3][DEBUG ] "name": "ceph-2",

[ceph-3][DEBUG ] "public_addr": "10.213.14.52:6789/0",

[ceph-3][DEBUG ] "rank": 1

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] {

[ceph-3][DEBUG ] "addr": "10.213.14.53:6789/0",

[ceph-3][DEBUG ] "name": "ceph-3",

[ceph-3][DEBUG ] "public_addr": "10.213.14.53:6789/0",

[ceph-3][DEBUG ] "rank": 2

[ceph-3][DEBUG ] }

[ceph-3][DEBUG ] ]

[ceph-3][DEBUG ] },

[ceph-3][DEBUG ] "name": "ceph-3",

[ceph-3][DEBUG ] "outside_quorum": [],

[ceph-3][DEBUG ] "quorum": [],

[ceph-3][DEBUG ] "rank": 2,

[ceph-3][DEBUG ] "state": "electing",

[ceph-3][DEBUG ] "sync_provider": []

[ceph-3][DEBUG ] }

[ceph-3][DEBUG ] ********************************************************************************

[ceph-3][INFO ] monitor: mon.ceph-3 is running

[ceph-3][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-3.asok mon_status

[ceph_deploy.mon][INFO ] processing monitor mon.ceph-1

[ceph-1][DEBUG ] connected to host: ceph-1

[ceph-1][DEBUG ] detect platform information from remote host

[ceph-1][DEBUG ] detect machine type

[ceph-1][DEBUG ] find the location of an executable

[ceph-1][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status

[ceph_deploy.mon][WARNIN] mon.ceph-1 monitor is not yet in quorum, tries left: 5

[ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying

[ceph-1][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status

[ceph_deploy.mon][INFO ] mon.ceph-1 monitor has reached quorum!

[ceph_deploy.mon][INFO ] processing monitor mon.ceph-2

[ceph-2][DEBUG ] connected to host: ceph-2

[ceph-2][DEBUG ] detect platform information from remote host

[ceph-2][DEBUG ] detect machine type

[ceph-2][DEBUG ] find the location of an executable

[ceph-2][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-2.asok mon_status

[ceph_deploy.mon][INFO ] mon.ceph-2 monitor has reached quorum!

[ceph_deploy.mon][INFO ] processing monitor mon.ceph-3

[ceph-3][DEBUG ] connected to host: ceph-3

[ceph-3][DEBUG ] detect platform information from remote host

[ceph-3][DEBUG ] detect machine type

[ceph-3][DEBUG ] find the location of an executable

[ceph-3][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-3.asok mon_status

[ceph_deploy.mon][INFO ] mon.ceph-3 monitor has reached quorum!

[ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum

[ceph_deploy.mon][INFO ] Running gatherkeys...

[ceph_deploy.gatherkeys][INFO ] Storing keys in temp directory /tmp/tmpNUhCCs

[ceph-1][DEBUG ] connected to host: ceph-1

[ceph-1][DEBUG ] detect platform information from remote host

[ceph-1][DEBUG ] detect machine type

[ceph-1][DEBUG ] get remote short hostname

[ceph-1][DEBUG ] fetch remote file

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph-1.asok mon_status

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get client.admin

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get-or-create client.admin osd allow * mds allow * mon allow * mgr allow *

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get client.bootstrap-mds

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get client.bootstrap-mgr

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get client.bootstrap-osd

[ceph-1][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph-1/keyring auth get client.bootstrap-rgw

[ceph_deploy.gatherkeys][INFO ] Storing ceph.client.admin.keyring

[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-mds.keyring

[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-mgr.keyring

[ceph_deploy.gatherkeys][INFO ] keyring 'ceph.mon.keyring' already exists

[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-osd.keyring

[ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-rgw.keyring

[ceph_deploy.gatherkeys][INFO ] Destroy temp directory /tmp/tmpNUhCCs

[root@ceph-1 ceph]# ceph -s
2018-04-17 21:47:38.302260 7f868a4e5700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.kg,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory
2018-04-17 21:47:38.302272 7f868a4e5700 -1 monclient: ERROR: missing keyring, cannot use cephx for authentication
2018-04-17 21:47:38.302274 7f868a4e5700  0 librados: client.admin initialization error (2) No such file or directory
[errno 2] error connecting to the cluster

解决：
[root@ceph-1 ceph]# ceph-deploy admin ceph-1 ceph-2 ceph-3

[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.0.0): /usr/bin/ceph-deploy admin ceph-1 ceph-2 ceph-3
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : 0x141ec20>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  client                        : ['ceph-1', 'ceph-2', 'ceph-3']
[ceph_deploy.cli][INFO  ]  func                          : <function admin at 0x1377e60>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph-1
[ceph-1][DEBUG ] connected to host: ceph-1 
[ceph-1][DEBUG ] detect platform information from remote host
[ceph-1][DEBUG ] detect machine type
[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph-2
[ceph-2][DEBUG ] connected to host: ceph-2 
[ceph-2][DEBUG ] detect platform information from remote host
[ceph-2][DEBUG ] detect machine type
[ceph-2][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph-3
[ceph-3][DEBUG ] connected to host: ceph-3 
[ceph-3][DEBUG ] detect platform information from remote host
[ceph-3][DEBUG ] detect machine type
[ceph-3][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[root@ceph-1 ceph]# 
[root@ceph-1 ceph]# 
[root@ceph-1 ceph]# 
[root@ceph-1 ceph]# ceph -s
  cluster:
    id:     2acc281e-dcb1-49d2-abb3-efcec654ae8c
    health: HEALTH_OK
 
  services:
    mon: 3 daemons, quorum ceph-1,ceph-2,ceph-3
    mgr: no daemons active
    osd: 0 osds: 0 up, 0 in
 
  data:
    pools:   0 pools, 0 pgs
    objects: 0 objects, 0 bytes
    usage:   0 kB used, 0 kB / 0 kB avail
    pgs:

6、创建osd

创建osd  注意要先分区，不能是裸盘  （每个节点暂用一块硬盘对应一个osd）
[root@ceph-1 ceph]# ceph-deploy osd create --data /dev/sde1  ceph-1
root@ceph-1 ceph]# ceph-deploy osd create --data /dev/sde1  ceph-1
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.0.0): /usr/bin/ceph-deploy osd create --data /dev/sde1 ceph-1
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  bluestore                     : None
[ceph_deploy.cli][INFO  ]  cd_conf                       : 0x7f2022216c68>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  fs_type                       : xfs
[ceph_deploy.cli][INFO  ]  block_wal                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  journal                       : None
[ceph_deploy.cli][INFO  ]  subcommand                    : create
[ceph_deploy.cli][INFO  ]  host                          : ceph-1
[ceph_deploy.cli][INFO  ]  filestore                     : None
[ceph_deploy.cli][INFO  ]  func                          : <function osd at 0x7f20221f9578>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  zap_disk                      : False
[ceph_deploy.cli][INFO  ]  data                          : /dev/sde1
[ceph_deploy.cli][INFO  ]  block_db                      : None
[ceph_deploy.cli][INFO  ]  dmcrypt                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  dmcrypt_key_dir               : /etc/ceph/dmcrypt-keys
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  debug                         : False
[ceph_deploy.osd][DEBUG ] Creating OSD on cluster ceph with data device /dev/sde1
[ceph-1][DEBUG ] connected to host: ceph-1 
[ceph-1][DEBUG ] detect platform information from remote host
[ceph-1][DEBUG ] detect machine type
[ceph-1][DEBUG ] find the location of an executable
[ceph_deploy.osd][INFO  ] Distro info: CentOS Linux 7.3.1611 Core
[ceph_deploy.osd][DEBUG ] Deploying osd to ceph-1
[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-1][DEBUG ] find the location of an executable
[ceph-1][INFO  ] Running command: /usr/sbin/ceph-volume --cluster ceph lvm create --bluestore --data /dev/sde1
[ceph-1][DEBUG ] Running command: ceph-authtool --gen-print-key
[ceph-1][DEBUG ] Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new e2778b0e-0965-4d3c-9ff9-3f126db4b0d6
[ceph-1][DEBUG ] Running command: vgcreate --force --yes ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c /dev/sde1
[ceph-1][DEBUG ]  stdout: Wiping xfs signature on /dev/sde1.
[ceph-1][DEBUG ]  stdout: Physical volume "/dev/sde1" successfully created.
[ceph-1][DEBUG ]  stdout: Volume group "ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c" successfully created
[ceph-1][DEBUG ] Running command: lvcreate --yes -l 100%FREE -n osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6 ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c
[ceph-1][DEBUG ]  stdout: Logical volume "osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6" created.
[ceph-1][DEBUG ] Running command: ceph-authtool --gen-print-key
[ceph-1][DEBUG ] Running command: mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
[ceph-1][DEBUG ] Running command: chown -R ceph:ceph /dev/dm-0
[ceph-1][DEBUG ] Running command: ln -s /dev/ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c/osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6 /var/lib/ceph/osd/ceph-0/block
[ceph-1][DEBUG ] Running command: ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap
[ceph-1][DEBUG ]  stderr: got monmap epoch 1
[ceph-1][DEBUG ] Running command: ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQB7stZarid9ExAAr4aIn6HZssfI6VWb/fs88Q==
[ceph-1][DEBUG ]  stdout: creating /var/lib/ceph/osd/ceph-0/keyring
[ceph-1][DEBUG ]  stdout: added entity osd.0 auth auth(auid = 18446744073709551615 key=AQB7stZarid9ExAAr4aIn6HZssfI6VWb/fs88Q== with 0 caps)
[ceph-1][DEBUG ] Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
[ceph-1][DEBUG ] Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
[ceph-1][DEBUG ] Running command: ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid e2778b0e-0965-4d3c-9ff9-3f126db4b0d6 --setuser ceph --setgroup ceph
[ceph-1][DEBUG ] --> ceph-volume lvm prepare successful for: /dev/sde1
[ceph-1][DEBUG ] Running command: ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c/osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6 --path /var/lib/ceph/osd/ceph-0
[ceph-1][DEBUG ] Running command: ln -snf /dev/ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c/osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6 /var/lib/ceph/osd/ceph-0/block
[ceph-1][DEBUG ] Running command: chown -R ceph:ceph /dev/dm-0
[ceph-1][DEBUG ] Running command: chown -R ceph:ceph /var/lib/ceph/osd/ceph-0
[ceph-1][DEBUG ] Running command: systemctl enable ceph-volume@lvm-0-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6
[ceph-1][DEBUG ]  stderr: Created symlink from /etc/systemd/system/multi-user.target.wants/ceph-volume@lvm-0-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6.service to /usr/lib/systemd/system/ceph-[email protected].
[ceph-1][DEBUG ] Running command: systemctl start ceph-osd@0
[ceph-1][DEBUG ] --> ceph-volume lvm activate successful for osd ID: 0
[ceph-1][DEBUG ] --> ceph-volume lvm activate successful for osd ID: None
[ceph-1][DEBUG ] --> ceph-volume lvm create successful for: /dev/sde1
[ceph-1][INFO  ] checking OSD status...
[ceph-1][DEBUG ] find the location of an executable
[ceph-1][INFO  ] Running command: /bin/ceph --cluster=ceph osd stat --format=json
[ceph_deploy.osd][DEBUG ] Host ceph-1 is now ready for osd use.

[root@ceph-1 ceph]# ll /var/lib/ceph/osd/
total 8
drwxrwxrwt 2 ceph ceph  300 Apr 17 22:50 ceph-0
-rw-r--r-- 1 root root 5084 Apr 17 22:35 ceph-deploy-ceph.log
[root@ceph-1 ceph]# ll /var/lib/ceph/osd/ceph-0/
total 48
-rw-r--r-- 1 ceph ceph 402 Apr 17 22:50 activate.monmap
lrwxrwxrwx 1 ceph ceph  93 Apr 17 22:50 block -> /dev/ceph-2acc281e-dcb1-49d2-abb3-efcec654ae8c/osd-block-e2778b0e-0965-4d3c-9ff9-3f126db4b0d6
-rw-r--r-- 1 ceph ceph   2 Apr 17 22:50 bluefs
-rw-r--r-- 1 ceph ceph  37 Apr 17 22:50 ceph_fsid
-rw-r--r-- 1 ceph ceph  37 Apr 17 22:50 fsid
-rw------- 1 ceph ceph  55 Apr 17 22:50 keyring
-rw-r--r-- 1 ceph ceph   8 Apr 17 22:50 kv_backend
-rw-r--r-- 1 ceph ceph  21 Apr 17 22:50 magic
-rw-r--r-- 1 ceph ceph   4 Apr 17 22:50 mkfs_done
-rw-r--r-- 1 ceph ceph  41 Apr 17 22:50 osd_key
-rw-r--r-- 1 ceph ceph   6 Apr 17 22:50 ready
-rw-r--r-- 1 ceph ceph  10 Apr 17 22:50 type
-rw-r--r-- 1 ceph ceph   2 Apr 17 22:50 whoami

[root@ceph-1 ceph]# ceph-deploy osd create --data /dev/sde1  ceph-2
[root@ceph-1 ceph]# ceph-deploy osd create --data /dev/sdf1  ceph-3

创建mgr（一台或三台创建都可以）Required only for luminous+ builds, i.e >= 12.x builds*

[root@ceph-1 ceph]# ceph-deploy mgr create ceph-1

[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf

[ceph_deploy.cli][INFO ] Invoked (2.0.0): /usr/bin/ceph-deploy mgr create ceph-1

[ceph_deploy.cli][INFO ] ceph-deploy options:

[ceph_deploy.cli][INFO ] username : None

[ceph_deploy.cli][INFO ] verbose : False

[ceph_deploy.cli][INFO ] mgr : [('ceph-1', 'ceph-1')]

[ceph_deploy.cli][INFO ] overwrite_conf : False

[ceph_deploy.cli][INFO ] subcommand : create

[ceph_deploy.cli][INFO ] quiet : False

[ceph_deploy.cli][INFO ] cd_conf :

[ceph_deploy.cli][INFO ] cluster : ceph

[ceph_deploy.cli][INFO ] func :

[ceph_deploy.cli][INFO ] ceph_conf : None

[ceph_deploy.cli][INFO ] default_release : False

[ceph_deploy.mgr][DEBUG ] Deploying mgr, cluster ceph hosts ceph-1:ceph-1

[ceph-1][DEBUG ] connected to host: ceph-1

[ceph-1][DEBUG ] detect platform information from remote host

[ceph-1][DEBUG ] detect machine type

[ceph_deploy.mgr][INFO ] Distro info: CentOS Linux 7.3.1611 Core

[ceph_deploy.mgr][DEBUG ] remote host will use systemd

[ceph_deploy.mgr][DEBUG ] deploying mgr bootstrap to ceph-1

[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf

[ceph-1][WARNIN] mgr keyring does not exist yet, creating one

[ceph-1][DEBUG ] create a keyring file

[ceph-1][DEBUG ] create path recursively if it doesn't exist

[ceph-1][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mgr --keyring /var/lib/ceph/bootstrap-mgr/ceph.keyring auth get-or-create mgr.ceph-1 mon allow profile mgr osd allow * mds allow * -o /var/lib/ceph/mgr/ceph-ceph-1/keyring

[ceph-1][INFO ] Running command: systemctl enable ceph-mgr@ceph-1

[ceph-1][WARNIN] Created symlink from /etc/systemd/system/ceph-mgr.target.wants/[email protected] to /usr/lib/systemd/system/[email protected].

[ceph-1][INFO ] Running command: systemctl start ceph-mgr@ceph-1

[ceph-1][INFO ] Running command: systemctl enable ceph.target

7、创建mon

创建mon
[root@ceph-1 ceph]# ceph-deploy mon create ceph-1
[root@ceph-1 ceph]# ceph-deploy mon create ceph-1
[ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
[ceph_deploy.cli][INFO  ] Invoked (2.0.0): /usr/bin/ceph-deploy mon create ceph-1
[ceph_deploy.cli][INFO  ] ceph-deploy options:
[ceph_deploy.cli][INFO  ]  username                      : None
[ceph_deploy.cli][INFO  ]  verbose                       : False
[ceph_deploy.cli][INFO  ]  overwrite_conf                : False
[ceph_deploy.cli][INFO  ]  subcommand                    : create
[ceph_deploy.cli][INFO  ]  quiet                         : False
[ceph_deploy.cli][INFO  ]  cd_conf                       : 0x7ffb65203830>
[ceph_deploy.cli][INFO  ]  cluster                       : ceph
[ceph_deploy.cli][INFO  ]  mon                           : ['ceph-1']
[ceph_deploy.cli][INFO  ]  func                          : <function mon at 0x7ffb651f30c8>
[ceph_deploy.cli][INFO  ]  ceph_conf                     : None
[ceph_deploy.cli][INFO  ]  default_release               : False
[ceph_deploy.cli][INFO  ]  keyrings                      : None
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph-1
[ceph_deploy.mon][DEBUG ] detecting platform for host ceph-1 ...
[ceph-1][DEBUG ] connected to host: ceph-1 
[ceph-1][DEBUG ] detect platform information from remote host
[ceph-1][DEBUG ] detect machine type
[ceph-1][DEBUG ] find the location of an executable
[ceph_deploy.mon][INFO  ] distro info: CentOS Linux 7.3.1611 Core
[ceph-1][DEBUG ] determining if provided host has same hostname in remote
[ceph-1][DEBUG ] get remote short hostname
[ceph-1][DEBUG ] deploying mon to ceph-1
[ceph-1][DEBUG ] get remote short hostname
[ceph-1][DEBUG ] remote hostname: ceph-1
[ceph-1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[ceph-1][DEBUG ] create the mon path if it does not exist
[ceph-1][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph-1/done
[ceph-1][DEBUG ] create a done file to avoid re-doing the mon deployment
[ceph-1][DEBUG ] create the init path if it does not exist
[ceph-1][INFO  ] Running command: systemctl enable ceph.target
[ceph-1][INFO  ] Running command: systemctl enable ceph-mon@ceph-1
[ceph-1][INFO  ] Running command: systemctl start ceph-mon@ceph-1
[ceph-1][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status
[ceph-1][DEBUG ] ********************************************************************************
[ceph-1][DEBUG ] status for monitor: mon.ceph-1
[ceph-1][DEBUG ] {
[ceph-1][DEBUG ]   "election_epoch": 6, 
[ceph-1][DEBUG ]   "extra_probe_peers": [
[ceph-1][DEBUG ]     "10.213.14.52:6789/0", 
[ceph-1][DEBUG ]     "10.213.14.53:6789/0"
[ceph-1][DEBUG ]   ], 
[ceph-1][DEBUG ]   "feature_map": {
[ceph-1][DEBUG ]     "client": {
[ceph-1][DEBUG ]       "group": {
[ceph-1][DEBUG ]         "features": "0x1ffddff8eea4fffb", 
[ceph-1][DEBUG ]         "num": 1, 
[ceph-1][DEBUG ]         "release": "luminous"
[ceph-1][DEBUG ]       }
[ceph-1][DEBUG ]     }, 
[ceph-1][DEBUG ]     "mon": {
[ceph-1][DEBUG ]       "group": {
[ceph-1][DEBUG ]         "features": "0x1ffddff8eea4fffb", 
[ceph-1][DEBUG ]         "num": 1, 
[ceph-1][DEBUG ]         "release": "luminous"
[ceph-1][DEBUG ]       }
[ceph-1][DEBUG ]     }, 
[ceph-1][DEBUG ]     "osd": {
[ceph-1][DEBUG ]       "group": {
[ceph-1][DEBUG ]         "features": "0x1ffddff8eea4fffb", 
[ceph-1][DEBUG ]         "num": 1, 
[ceph-1][DEBUG ]         "release": "luminous"
[ceph-1][DEBUG ]       }
[ceph-1][DEBUG ]     }
[ceph-1][DEBUG ]   }, 
[ceph-1][DEBUG ]   "features": {
[ceph-1][DEBUG ]     "quorum_con": "2305244844532236283", 
[ceph-1][DEBUG ]     "quorum_mon": [
[ceph-1][DEBUG ]       "kraken", 
[ceph-1][DEBUG ]       "luminous"
[ceph-1][DEBUG ]     ], 
[ceph-1][DEBUG ]     "required_con": "153140804152475648", 
[ceph-1][DEBUG ]     "required_mon": [
[ceph-1][DEBUG ]       "kraken", 
[ceph-1][DEBUG ]       "luminous"
[ceph-1][DEBUG ]     ]
[ceph-1][DEBUG ]   }, 
[ceph-1][DEBUG ]   "monmap": {
[ceph-1][DEBUG ]     "created": "2018-04-17 21:42:59.721694", 
[ceph-1][DEBUG ]     "epoch": 1, 
[ceph-1][DEBUG ]     "features": {
[ceph-1][DEBUG ]       "optional": [], 
[ceph-1][DEBUG ]       "persistent": [
[ceph-1][DEBUG ]         "kraken", 
[ceph-1][DEBUG ]         "luminous"
[ceph-1][DEBUG ]       ]
[ceph-1][DEBUG ]     }, 
[ceph-1][DEBUG ]     "fsid": "2acc281e-dcb1-49d2-abb3-efcec654ae8c", 
[ceph-1][DEBUG ]     "modified": "2018-04-17 21:42:59.721694", 
[ceph-1][DEBUG ]     "mons": [
[ceph-1][DEBUG ]       {
[ceph-1][DEBUG ]         "addr": "10.213.14.51:6789/0", 
[ceph-1][DEBUG ]         "name": "ceph-1", 
[ceph-1][DEBUG ]         "public_addr": "10.213.14.51:6789/0", 
[ceph-1][DEBUG ]         "rank": 0
[ceph-1][DEBUG ]       }, 
[ceph-1][DEBUG ]       {
[ceph-1][DEBUG ]         "addr": "10.213.14.52:6789/0", 
[ceph-1][DEBUG ]         "name": "ceph-2", 
[ceph-1][DEBUG ]         "public_addr": "10.213.14.52:6789/0", 
[ceph-1][DEBUG ]         "rank": 1
[ceph-1][DEBUG ]       }, 
[ceph-1][DEBUG ]       {
[ceph-1][DEBUG ]         "addr": "10.213.14.53:6789/0", 
[ceph-1][DEBUG ]         "name": "ceph-3", 
[ceph-1][DEBUG ]         "public_addr": "10.213.14.53:6789/0", 
[ceph-1][DEBUG ]         "rank": 2
[ceph-1][DEBUG ]       }
[ceph-1][DEBUG ]     ]
[ceph-1][DEBUG ]   }, 
[ceph-1][DEBUG ]   "name": "ceph-1", 
[ceph-1][DEBUG ]   "outside_quorum": [], 
[ceph-1][DEBUG ]   "quorum": [
[ceph-1][DEBUG ]     0, 
[ceph-1][DEBUG ]     1, 
[ceph-1][DEBUG ]     2
[ceph-1][DEBUG ]   ], 
[ceph-1][DEBUG ]   "rank": 0, 
[ceph-1][DEBUG ]   "state": "leader", 
[ceph-1][DEBUG ]   "sync_provider": []
[ceph-1][DEBUG ] }
[ceph-1][DEBUG ] ********************************************************************************
[ceph-1][INFO  ] monitor: mon.ceph-1 is running
[ceph-1][INFO  ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph-1.asok mon_status

ceph-deploy mon create ceph-2
ceph-deploy mon create ceph-3

查看mon状态
[root@ceph-1 ceph]# ceph quorum_status --format json-pretty

8、启用dashboard

启用dashborad

[root@ceph-1 ceph]# ceph mgr module enable dashboard

http://10.213.14.51:7000/

至此整个ceph集群构建完毕，下面测试rbd块存储

[root@ceph-3 ~]# ceph osd pool create test1 128 #创建新的存储池，而不是使用默认的rbd

[root@ceph-3 ~]# rbd create --size 100G image-1 --pool test1 #创建一个快

[root@ceph-3 ~]# rbd info image-1 --pool test1 #查看rbd信息

root@ceph-3 ~]# rbd --pool test1 feature disable image-1 exclusive-lock, object-map, fast-diff, deep-flatten #禁用不支持的属性

[root@ceph-3 ~]# rbd map --pool test1 image-1 #映射块 image-1 到本地

/dev/rbd0

[root@ceph-3 ~]# mkfs.ext4 /dev/rbd0 #格式化块设备

[root@ceph-1 ~]# ceph osd pool application enable test1 rbd

enabled application 'rbd' on pool 'test1'

测试写入数

[root@ceph-3 rbd]# dd if=/dev/zero of=/mnt/rbd/a count=30000 bs=1M

30000+0 records in

30000+0 records out

31457280000 bytes (31 GB) copied, 66.36 s, 474 MB/s

删除ceph

ceph-deploy purge ceph-1 ceph-2 ceph-3

ceph-deploy purgedata ceph-1 ceph-2 ceph-3

ceph-deploy forgetkeys

参考文档

http://docs.ceph.org.cn/

http://docs.ceph.com/

转载于:https://www.cnblogs.com/hellojackyleon/p/8880986.html

你可能感兴趣的:(分布式存储ceph集群实践)

拥有断舍离的心态，过精简生活--《断舍离》读书笔记爱吃丸子的小樱桃
不知不觉间房间里的东西越来越多，虽然摆放整齐，但也时常会觉得空间逼仄，令人心生烦闷。抱着断舍离的态度，我开始阅读《断舍离》这本书，希望从书中能找到一些有效的方法，帮助我实现空间、物品上的断舍离。《断舍离》是日本作家山下英子通过自己的经历、思考和实践总结而成的，整体内涵也从刚开始的私人生活哲学的“断舍离”升华成了“人生实践哲学”，接着又成为每个人都能实行的“改变人生的断舍离”，从“哲学”逐渐升华成“
数组去重好奇的猫猫猫
整理自js中基础数据结构数组去重问题思考？如何去除数组中重复的项例如数组：[1,3,4,3,5]我们在做去重的时候，一开始想到的肯定是，逐个比较，外面一层循环，内层后一个与前一个一比较，如果是久不将当前这一项放进新的数组，挨个比较完之后返回一个新的去过重复的数组不好的实践方式上述方法效率极低，代码量还多，思考？有没有更好的方法这时候不禁一想当然有了！！！hashtable啊，通过对象的hash办法
把握“三度”打造“三有”干部队伍辛德瑞拉卡卡卡
“胜败兴亡之分，不得不归咎于人事也”。干部队伍建设工作的好坏，关系到党和国家的发展全局。近日，新疆维吾尔自治区党委书记马兴瑞在部分党群单位走访调研时强调，要努力培养造就忠诚干净担当的高素质专业化干部队伍。各级组织部门应当在培养选拔干部、吸收优秀青年到党内来、培养造就优秀人才上下功夫，切实增强干部投身实践、解决问题、推进工作的能力，着力打造高素质专业化干部队伍。“天生我材必有用”，增强选育有“准度”
读书||陶新华《教育中的积极心理学》1—28 流水淙淙2022
读一本好书，尤如和一位高尚者对话，亦能对人的精神进行洗礼。但是若不能和实践结合起来，也只能落到空读书的状态。读书摘要与感想1、塞利格曼在《持续的幸福》一书中提出了幸福2.0理论，提出幸福由5个元素决定——积极情绪、投入的工作和生活、目标和意义、和谐的人际关系、成就感。2、人的大脑皮层在进行智力活动时，都伴有皮下中枢活动，对这些活动进行体验请假，并由此产生了情感解读。人的情绪情感体验总是优先于大脑的
2019-01-19 王小康KK
姓名:王康公司:扬州市方圆建筑工程有限公司2018年3月16日～3月18日上海361期《六项精进》感谢二组学员【日精进打卡第307天】【知～学习】《六项精进》大纲3遍共862遍《大学》通篇3遍共860遍《六项精进》全书40页【经典名句】思想决定行为，行为决定习惯，习惯决定性格，性格决定命运。【行～实践】一、修身：（对自己个人）1、践行六项精进的理念。二、齐家：（对家庭和家人）1、和女朋友视频聊天。
提高教师信息素养，提高道德与法治课教学效益长白159宋彦红
提高教师信息素养，提高道德与法治课教学效益随着经济和社会的发展，信息技术已经运用到课堂教学中，为课堂教学展示了一个崭新的天地。的确，信息技术形象、生动、直观性强，能够将课本中的一些抽想的概念直接展示在学生面前，从而调动学生的眼、耳、脑，让他们兴奋起来，变被动学习为主动学习，充分发挥教师的教育引导作用，创造一个可以使学生积极参与的场景。在制作、使用信息技术的实践过程中，本文拟就教师提升信息素养的必要
【六项精进】20180930 Kinnfoo
一、学习与实践1.付出不亚于任何人的努力2.要谦虚，不要骄傲3.要每天反省4.活着，就要感谢5.积善行，思利他6.不要有感性的烦恼二、今日分享今天是9月的最后一个工作日，每个支行都在拼命地冲刺业绩，刚好今天同桌休假了，我就替他审核客户。一个上午就进件了6个客户，审核通过5个。这5个审核通过的客户里，1个因费率没谈拢而放弃，1个因车上发现GPS而被拒单，最终确认可放款的只有3个客户。感叹支行同事的不
语文主题教学学习笔记之87 东哥杂谈
“语文主题教学”学习笔记之八十七（0125）今天继续学习小学语文主题教学的实践样态。板块三：教学中体现“书艺”味道。作为四大名著之一的《水浒传》，堪称我国文学宝库之经典。对从《水浒传》中摘选的单元，教师就要了解其原生态，即评书体特点。这也要求教师要了解一些常用的评书行话术语，然后在教学时适时地加入一些，让学生体味其文本中原有的特色。学生也要尽可能地通过朗读的方式，而不单是分析讲解的方式进行学习。细
2019-03-24 李飞720
姓名：李飞企业名称：临沂鑫道食品有限公司组别373期利他1组日精进打卡第338天】【知~学习】1、阿米巴经营一段2、活用人才1段3、活法、一段【行~实践】一、修身：读书、抽烟减量、俯卧撑个跑步3公里二、齐家、劝说老爸与姑姑和好三、建功、业务洽谈【经典名句分享】1、依据原理原则追求事物的本质，以“作为人，何谓正确”进行判断2、经营者必须为员工物质和精神两方面的幸福殚精竭虑，倾尽全力，必须超脱私心，让
MongoDB知识概括 GeorgeLin98 持久层 mongodb
MongoDB知识概括MongoDB相关概念单机部署基本常用命令索引-IndexSpirngDataMongoDB集成副本集分片集群安全认证MongoDB相关概念业务应用场景：传统的关系型数据库（如MySQL），在数据操作的“三高”需求以及应对Web2.0的网站需求面前，显得力不从心。解释：“三高”需求：①Highperformance-对数据库高并发读写的需求。②HugeStorage-对海量数
【RabbitMQ 项目】服务端：数据管理模块之绑定管理月夜星辉雪 rabbitmq 分布式
文章目录一.编写思路二.代码实践一.编写思路定义绑定信息类交换机名称队列名称绑定关键字：交换机的路由交换算法中会用到没有是否持久化的标志，因为绑定是否持久化取决于交换机和队列是否持久化，只有它们都持久化时绑定才需要持久化。绑定就好像一根绳子，两端连接着交换机和队列，当一方不存在，它就没有存在的必要了定义绑定持久化类构造函数：如果数据库文件不存在则创建，打开数据库，创建binding_table插入
2019-04-10 shuaigefeng
姓名：王林锋企业名称：三亚蔚蓝时代实业有限公司组别：420期努力6组【日精进打卡251天】【知~学习、诵读】《六项精进》2遍，累计256遍《大学》2遍，累计220遍【经典分享】1、想过成功、想过失败、也想过放弃。【行~实践】一、修身：（对自己个人）1.拍打腿部两侧50下，舌顶上颚50下。2.坚持诵读、阅读。3.坚持锻炼、按时睡觉起床。4.控制健康饮食，饭后走动30分钟。5.每天反省自己的思想和行为
Python 课程10-单元测试可愛小吉 Python教學 python 单元测试开发语言 TDD unittest
前言在现代软件开发中，单元测试已成为一种必不可少的实践。通过测试，我们可以确保每个功能模块在开发和修改过程中按预期工作，从而减少软件缺陷，提高代码质量。而测试驱动开发（TDD）则进一步将测试作为开发的核心部分，先编写测试，再编写代码，以测试为指导开发出更稳定、更可靠的代码。Python提供了强大的unittest模块，它是Python标准库的一部分，专门用于编写和执行单元测试。与其他测试框架相比，
100天持续行动—Day01 Richard_DL
今天开始站着学习，发现效率大幅提升。把fast.ai的Lesson1的后半部分和Lesson2看完了。由于Keras版本和视频中的不一致，运行notebook时经常出现莫名其妙的错误，导致自己只动手实践了视频中的一小部分内容。为了赶时间，我打算先把与CNN相关的视频过一遍。然后尽快开始做自己的项目。明天继续加油，争取把Lesson3和Lesson4看完。
孩子强迫症，厌学叛逆，家长怎么办？扶禾心理
01最近，我们的公众号后台收到了很多家长的私信，很多家长说，孩子在进入青春期后，不知不觉竟然有强迫行为，特别容易钻牛角尖，沉迷网络，厌学，顶撞父母。他们为此很苦恼，不知道怎么办。强迫症正在成为儿童和青少年中常见的精神障碍之一。强迫症是一种长期逐步形成的心理问题，是一种慢性、难治性心理疾病。在这里，我们分享一些咨询实践及思路供家长参考，希望对更多的家长和孩子有帮助。一位家长私信我们说，她儿子14岁，
干货|自我介绍这三个坑，99%的概率你踩过！夏麦生命的魔术师
自我介绍——每个人都需要的一张名片。图片源自网络从2018年到现在，在做演讲俱乐部的2年时间里，我在演讲活动现场听过1000+人的自我介绍，自我介绍做得超棒的人真不多！最近，我花了近几个月时间，仔细研究了500+人线上场景的自我介绍，发现优秀的自我介绍也不多！为什么做一张优秀的自我介绍就这么难呢？这个问题，在我帮几十个人打造了自我介绍的过程一直困扰着我。经过了几个月的时间思考与实践，终于发现三个—
[实践应用] 深度学习之模型性能评估指标 YuanDaima2048 深度学习工具使用深度学习人工智能损失函数性能评估 pytorch python 机器学习
文章总览：YuanDaiMa2048博客文章总览深度学习之模型性能评估指标分类任务回归任务排序任务聚类任务生成任务其他介绍在机器学习和深度学习领域，评估模型性能是一项至关重要的任务。不同的学习任务需要不同的性能指标来衡量模型的有效性。以下是对一些常见任务及其相应的性能评估指标的详细解释和总结。分类任务分类任务是指模型需要将输入数据分配到预定义的类别或标签中。以下是分类任务中常用的性能指标：准确率(
[实践应用] 深度学习之优化器 YuanDaima2048 深度学习工具使用 pytorch 深度学习人工智能机器学习 python 优化器
文章总览：YuanDaiMa2048博客文章总览深度学习之优化器1.随机梯度下降（SGD）2.动量优化（Momentum）3.自适应梯度（Adagrad）4.自适应矩估计（Adam）5.RMSprop总结其他介绍在深度学习中，优化器用于更新模型的参数，以最小化损失函数。常见的优化函数有很多种，下面是几种主流的优化器及其特点、原理和PyTorch实现：1.随机梯度下降（SGD）原理:随机梯度下降通过
字节二面 Redstone Monstrosity 前端面试
1.假设你是正在面试前端开发工程师的候选人，面试官让你详细说出你上一段实习过程的收获和感悟。在上一段实习过程中，我获得了宝贵的实践经验和深刻的行业洞察，以下是我的主要收获和感悟：一、专业技能提升框架应用熟练度：通过实际项目，我深入掌握了React、Vue等前端框架的使用，不仅提升了编码效率，还学会了如何根据项目需求选择合适的框架。问题解决能力：在实习期间，我遇到了许多预料之外的技术难题。通过查阅文
HarmonyOS开发实战（ Beta5.0）搜索框热搜词自动切换让开，我要吃人了 OpenHarmony HarmonyOS 鸿蒙开发 harmonyos 华为鸿蒙移动开发鸿蒙系统前端开发语言
鸿蒙HarmonyOS开发往期必看：HarmonyOSNEXT应用开发性能实践总结最新版！“非常详细的”鸿蒙HarmonyOSNext应用开发学习路线！（从零基础入门到精通）介绍本示例介绍使用TextInput组件与Swiper组件实现搜索框内热搜词自动切换。效果图预览使用说明页面顶部搜索框内热搜词条自动切换，编辑搜索框时自动隐藏。实现思路使用TextInput实现搜索框TextInput({te
python老是报参数未定义_Python函数默认参数常见问题及解决方案 weixin_39935571 python老是报参数未定义
一、默认参数python为了简化函数的调用，提供了默认参数机制：这样在调用pow函数时，就可以省略最后一个参数不写：在定义有默认参数的函数时，需要注意以下：必选参数必须在前面，默认参数在后；设置何种参数为默认参数？一般来说，将参数值变化小的设置为默认参数。python标准库实践python内建函数：函数签名可以看出，使用print('hellopython')这样的简单调用的打印语句，实际上传入了
2022-5-23《儿童纪律教育》培训手捧鲜花_54e3
张子博春蕾八幼缺乏技能导致的问题，需要老师和家长教授儿童所需要的锻炼的技能。比如教授儿童如何处理情绪、与人相处以及有效的交流技巧。未满足的情感需要，如信任、尊重、爱与权利的需要，都应该让儿童充分得到满足时，才能解决问题。家庭互动与复杂的原因，需要教师建立以家庭为中心的实践，和家庭沟通，建立和谐的关系，为孩子的健康成长共同努力。
98_es生产集群部署之针对集群重启时的shard恢复耗时过长问题定制的重要参数小山居
98_es生产集群部署之针对集群重启时的shard恢复耗时过长问题定制的重要参数shardrecovery配置以及集群重启时的无意义shard重分配问题在集群重启的时候，有一些配置会影响shard恢复的过程。首先，我们需要理解默认配置下，shard恢复过程会发生什么事情。如果我们有10个node，每个node都有一个shard，可能是primaryshard或者replicashard，你有一个i
metaRTC/webRTC QOS 方案与实践 metaRTC metaRTC 解决方案 webrtc qos
概述质量服务(QOS/QualityofService)是指利用各种技术方案提高网络通信质量的技术，网络通信质量需要解决下面两个问题：网络问题：UDP/不稳定网络/弱网下的丢包/延时/乱序/抖动数据量问题：发送数据量超带宽负载和平滑发送拥塞控制是各种技术方案的数据基础，丢包恢复解决丢包问题，抗乱序抖动解决网络乱序抖动问题，流量控制解决平滑发送数据/数据超带宽负载/延时问题。拥塞控制(Congest
《HTML 与 CSS—— 响应式设计》陈在天box html css 前端
一、引言在当今数字化时代，人们使用各种不同的设备访问互联网，包括智能手机、平板电脑、笔记本电脑和台式机等。为了确保网站在不同设备上都能提供良好的用户体验，响应式设计成为了网页开发的关键。HTML和CSS作为网页开发的基础技术，在实现响应式设计方面发挥着重要作用。本文将深入探讨HTML与CSS中的响应式设计原理、方法和最佳实践。二、响应式设计的概念与重要性（一）概念响应式设计是一种网页设计方法，旨在
【从问题中去学习k8s】k8s中的常见面试题（夯实理论基础）（二十八）向往风的男子 k8s 学习 kubernetes 容器
本站以分享各种运维经验和运维所需要的技能为主《python零基础入门》：python零基础入门学习《python运维脚本》：python运维脚本实践《shell》：shell学习《terraform》持续更新中：terraform_Aws学习零基础入门到最佳实战《k8》从问题中去学习k8s《docker学习》暂未更新《ceph学习》ceph日常问题解决分享《日志收集》ELK+各种中间件《运维日常》
KVM+GFS分布式存储系统构建KVM高可用 henan程序媛分布式 GFS 高可用 KVM
一、案列分析1.1案列概述本章案例主要使用之前章节所学的KVM及GlusterFs技术,结合起来从而实现KVM高可用。利用GlusterFs分布式复制卷，对KVM虚拟机文件进行分布存储和冗余。分布式复制卷主要用于需要冗余的情况下把一个文件存放在两个或两个以上的节点,当其中一个节点数据丢失或者损坏之后，KVM仍然能够通过卷组找到另一节点上存储的虚拟机文件，以保证虚拟机正常运行。当节点修复之后，Glu
Nginx从入门到实践(三) 听你讲故事啊
动静分离动静分离是将网站静态资源（JavaScript，CSS，img等文件）与后台应用分开部署，提高用户访问静态代码的速度，降低对后台应用访问。动静分离的一种做法是将静态资源部署在nginx上，后台项目部署到应用服务器上，根据一定规则静态资源的请求全部请求nginx服务器，达到动静分离的目标。rewrite规则Rewrite规则常见正则表达式Rewrite主要的功能就是实现URL的重写，Ngin
Hadoop 傲雪凌霜，松柏长青后端大数据 hadoop 大数据分布式
ApacheHadoop是一个开源的分布式计算框架，主要用于处理海量数据集。它具有高度的可扩展性、容错性和高效的分布式存储与计算能力。Hadoop核心由四个主要模块组成，分别是HDFS（分布式文件系统）、MapReduce（分布式计算框架）、YARN（资源管理）和HadoopCommon（公共工具和库）。1.HDFS（HadoopDistributedFileSystem）HDFS是Hadoop生
【Kubernetes】常见面试题汇总（十一） summer.335 Kubernetes kubernetes 容器云原生
目录33.简述Kubernetes外部如何访问集群内的服务？34.简述Kubernetesingress？35.简述Kubernetes镜像的下载策略？33.简述Kubernetes外部如何访问集群内的服务？（1）对于Kubernetes，集群外的客户端默认情况，无法通过Pod的IP地址或者Service的虚拟IP地址：虚拟端口号进行访问。（2）通常可以通过以下方式进行访问Kubernetes集群
github中多个平台共存 jackyrong github
在个人电脑上，如何分别链接比如oschina,github等库呢，一般教程之列的，默认 ssh链接一个托管的而已，下面讲解如何放两个文件 1）设置用户名和邮件地址 $ git config --global user.name "xx" $ git config --global user.email "[email protected]"
ip地址与整数的相互转换(javascript) alxw4616 JavaScript
//IP转成整型 function ip2int(ip){ var num = 0; ip = ip.split("."); num = Number(ip[0]) * 256 * 256 * 256 + Number(ip[1]) * 256 * 256 + Number(ip[2]) * 256 + Number(ip[3]); n
读书笔记-jquey+数据库+css chengxuyuancsdn html jquery oracle
1、grouping ,group by rollup, GROUP BY GROUPING SETS区别 2、$("#totalTable tbody>tr td:nth-child(" + i + ")").css({"width":tdWidth, "margin":"0px", &q
javaSE javaEE javaME == API下载 Array_06 java
oracle下载各种API文档： http://www.oracle.com/technetwork/java/embedded/javame/embed-me/documentation/javame-embedded-apis-2181154.html JavaSE文档： http://docs.oracle.com/javase/8/docs/api/ JavaEE文档： ht
shiro入门学习 cugfy java Web 框架
声明本文只适合初学者，本人也是刚接触而已，经过一段时间的研究小有收获，特来分享下希望和大家互相交流学习。首先配置我们的web.xml代码如下，固定格式，记死就成 <filter> <filter-name>shiroFilter</filter-name> &nbs
Array添加删除方法 357029540 js
刚才做项目前台删除数组的固定下标值时，删除得不是很完整，所以在网上查了下，发现一个不错的方法，也提供给需要的同学。 //给数组添加删除 Array.prototype.del = function(n){
navigation bar 更改颜色张亚雄 IO
今天郁闷了一下午，就因为objective-c默认语言是英文，我写的中文全是一些乱七八糟的样子，到不是乱码，但是，前两个自字是粗体，后两个字正常体，这可郁闷死我了，问了问大牛，人家告诉我说更改一下字体就好啦，比如改成黑体，哇塞，茅塞顿开。翻书看，发现，书上有介绍怎么更改表格中文字字体的，代码如下
unicode转换成中文 adminjun unicode 编码转换
在Java程序中总会出现\u6b22\u8fce\u63d0\u4ea4\u5fae\u535a\u641c\u7d22\u4f7f\u7528\u53cd\u9988\uff0c\u8bf7\u76f4\u63a5这个的字符，这是unicode编码，使用时有时候不会自动转换成中文就需要自己转换了使用下面的方法转换一下即可。 /** * unicode 转换成中文
一站式 Java Web 框架 firefly aijuans Java Web
Firefly是一个高性能一站式Web框架。涵盖了web开发的主要技术栈。包含Template engine、IOC、MVC framework、HTTP Server、Common tools、Log、Json parser等模块。 firefly-2.0_07修复了模版压缩对javascript单行注释的影响，并新增了自定义错误页面功能。更新日志：增加自定义系统错误页面功能
设计模式——单例模式 ayaoxinchao 设计模式
定义 Java中单例模式定义：“一个类有且仅有一个实例，并且自行实例化向整个系统提供。” 分析从定义中可以看出单例的要点有三个：一是某个类只能有一个实例；二是必须自行创建这个实例；三是必须自行向系统提供这个实例。 &nb
Javascript 多浏览器兼容性问题及解决方案 BigBird2012 JavaScript
不论是网站应用还是学习js,大家很注重ie与firefox等浏览器的兼容性问题，毕竟这两中浏览器是占了绝大多数。一、document.formName.item(”itemName”) 问题问题说明：IE下，可以使用 document.formName.item(”itemName”) 或 document.formName.elements ["elementName&quo
JUnit-4.11使用报java.lang.NoClassDefFoundError: org/hamcrest/SelfDescribing错误 bijian1013 junit4.11 单元测试
下载了最新的JUnit版本，是4.11，结果尝试使用发现总是报java.lang.NoClassDefFoundError: org/hamcrest/SelfDescribing这样的错误，上网查了一下，一般的解决方案是，换一个低一点的版本就好了。还有人说，是缺少hamcrest的包。去官网看了一下，如下发现：
[Zookeeper学习笔记之二]Zookeeper部署脚本 bit1129 zookeeper
Zookeeper伪分布式安装脚本(此脚本在一台机器上创建Zookeeper三个进程，即创建具有三个节点的Zookeeper集群。这个脚本和zookeeper的tar包放在同一个目录下，脚本中指定的名字是zookeeper的3.4.6版本，需要根据实际情况修改)： #!/bin/bash #!!!Change the name!!! #The zookeepe
【Spark八十】Spark RDD API二 bit1129 spark
coGroup package spark.examples.rddapi import org.apache.spark.{SparkConf, SparkContext} import org.apache.spark.SparkContext._ object CoGroupTest_05 { def main(args: Array[String]) { v
Linux中编译apache服务器modules文件夹缺少模块(.so)的问题 ronin47 modules
在modules目录中只有httpd.exp，那些so文件呢？我尝试在fedora core 3中安装apache 2. 当我解压了apache 2.0.54后使用configure工具并且加入了 --enable-so 或者 --enable-modules=so (两个我都试过了) 去make并且make install了。我希望在/apache2/modules/目录里有各种模块，
Java基础-克隆 BrokenDreams java基础
Java中怎么拷贝一个对象呢？可以通过调用这个对象类型的构造器构造一个新对象，然后将要拷贝对象的属性设置到新对象里面。Java中也有另一种不通过构造器来拷贝对象的方式，这种方式称为克隆。 Java提供了java.lang.
读《研磨设计模式》-代码笔记-适配器模式-Adapter bylijinnan java 设计模式
声明：本文只为方便我个人查阅和理解，详细的分析以及源代码请移步原作者的博客http://chjavach.iteye.com/ package design.pattern; /* * 适配器模式解决的主要问题是，现有的方法接口与客户要求的方法接口不一致 * 可以这样想，我们要写这样一个类（Adapter）: * 1.这个类要符合客户的要求 ---> 那显然要
HDR图像PS教程集锦&心得 cherishLC PS
HDR是指高动态范围的图像，主要原理为提高图像的局部对比度。软件有photomatix和nik hdr efex。一、教程叶明在知乎上的回答： http://www.zhihu.com/question/27418267/answer/37317792 大意是修完后直方图最好是等值直方图，方法是HDR软件调一遍，再结合不透明度和蒙版细调。二、心得 1、去除阴影部分的
maven-3.3.3 mvn archetype 列表 crabdave ArcheType
maven-3.3.3 mvn archetype 列表可以参考最新的：http://repo1.maven.org/maven2/archetype-catalog.xml [INFO] Scanning for projects... [INFO]
linux shell 中文件编码查看及转换方法 daizj shell 中文乱码 vim 文件编码
一、查看文件编码。在打开文件的时候输入:set fileencoding 即可显示文件编码格式。二、文件编码转换 1、在Vim中直接进行转换文件编码,比如将一个文件转换成utf-8格式 &
MySQL--binlog日志恢复数据 dcj3sjt126com binlog
恢复数据的重要命令如下 mysql> flush logs; 默认的日志是mysql-bin.000001，现在刷新了重新开启一个就多了一个mysql-bin.000002
数据库中数据表数据迁移方法 dcj3sjt126com sql
刚开始想想好像挺麻烦的，后来找到一种方法了，就SQL中的 INSERT 语句，不过内容是现从另外的表中查出来的，其实就是 MySQL中INSERT INTO SELECT的使用下面看看如何使用语法：MySQL中INSERT INTO SELECT的使用 1. 语法介绍有三张表a、b、c，现在需要从表b
Java反转字符串 dyy_gusi java 反转字符串
前几天看见一篇文章，说使用Java能用几种方式反转一个字符串。首先要明白什么叫反转字符串，就是将一个字符串到过来啦，比如"倒过来念的是小狗"反转过来就是”狗小是的念来过倒“。接下来就把自己能想到的所有方式记录下来了。 1、第一个念头就是直接使用String类的反转方法，对不起，这样是不行的，因为Stri
UI设计中我们为什么需要设计动效 gcq511120594 UI linux
随着国际大品牌苹果和谷歌的引领，最近越来越多的国内公司开始关注动效设计了，越来越多的团队已经意识到动效在产品用户体验中的重要性了，更多的UI设计师们也开始投身动效设计领域。但是说到底，我们到底为什么需要动效设计？或者说我们到底需要什么样的动效？做动效设计也有段时间了，于是尝试用一些案例，从产品本身出发来说说我所思考的动效设计。一、加强体验舒适度嗯，就是让用户更加爽更加爽的用
JBOSS服务部署端口冲突问题 HogwartsRow java 应用服务器 jboss server EJB3
服务端口冲突问题的解决方法，一般修改如下三个文件中的部分端口就可以了。 1、jboss5/server/default/conf/bindingservice.beans/META-INF/bindings-jboss-beans.xml 2、./server/default/deploy/jbossweb.sar/server.xml 3、.
第三章 Redis/SSDB+Twemproxy安装与使用 jinnianshilongnian ssdb reids twemproxy
目前对于互联网公司不使用Redis的很少，Redis不仅仅可以作为key-value缓存，而且提供了丰富的数据结果如set、list、map等，可以实现很多复杂的功能；但是Redis本身主要用作内存缓存，不适合做持久化存储，因此目前有如SSDB、ARDB等，还有如京东的JIMDB，它们都支持Redis协议，可以支持Redis客户端直接访问；而这些持久化存储大多数使用了如LevelDB、RocksD
ZooKeeper原理及使用 liyonghui160com
ZooKeeper是Hadoop Ecosystem中非常重要的组件，它的主要功能是为分布式系统提供一致性协调(Coordination)服务，与之对应的Google的类似服务叫Chubby。今天这篇文章分为三个部分来介绍ZooKeeper，第一部分介绍ZooKeeper的基本原理，第二部分介绍ZooKeeper
程序员解决问题的60个策略 pda158 框架工作单元测试
根本的指导方针 1. 首先写代码的时候最好不要有缺陷。最好的修复方法就是让 bug 胎死腹中。良好的单元测试强制数据库约束使用输入验证框架避免未实现的“else”条件在应用到主程序之前知道如何在孤立的情况下使用日志 2. print 语句。往往额外输出个一两行将有助于隔离问题。 3. 切换至详细的日志记录。详细的日
Create the Google Play Account sillycat Google
Create the Google Play Account Having a Google account, pay 25$, then you get your google developer account. References: http://developer.android.com/distribute/googleplay/start.html https://p
JSP三大指令 vikingwei jsp
JSP三大指令一个jsp页面中，可以有0~N个指令的定义！ 1. page --> 最复杂：<%@page language="java" info="xxx"...%> * pageEncoding和contentType： > pageEncoding：它