前言
银行的数据安全性是放在首位的,使用oracle定制版
热备份:无需关机,无需关闭业务,就可直接识别
逻辑备份是对某个表、数据库备份
逻辑上的一张表映射出物理层面的三个文件:
表的结构文件frm,表的数据文件MYD,表的索引文件MYI
完全备份:会把服务器内的所有数据全部备份,每次都这么执行
优点:安全
缺点:数据备份冗余,占用磁盘空间
差异 增量
相同点:基础都是完全备份
不同点:差异备份只参考基础的完全备份,
增量备份是参考上一次的数据备份与当前状态进行对比,备份被修改的文件
增量备份效率更高,空间利用率很高,但是在安全性能不高
[root@localhost ~]# systemctl stop firewalld
[root@localhost ~]# setenforce 0
[root@localhost ~]# systemctl restart mysqld
[root@localhost ~]# mysql -uroot -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| bbs |
| mysql |
| performance_schema |
| sys |
+--------------------+
5 rows in set (0.00 sec)
mysql> create database school;
Query OK, 1 row affected (0.00 sec)
mysql> use school;
Database changed
mysql> create table info (id int(4) not null primary key auto_increment,name varchar(10) not null,score decimal(4,1) not null);
Query OK, 0 rows affected (0.01 sec)
mysql> desc info;
+-------+--------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+-------+--------------+------+-----+---------+----------------+
| id | int(4) | NO | PRI | NULL | auto_increment |
| name | varchar(10) | NO | | NULL | |
| score | decimal(4,1) | NO | | NULL | |
+-------+--------------+------+-----+---------+----------------+
3 rows in set (0.05 sec)
mysql> insert into info (name,score) values ('stu01',88),('stu02',77);
Query OK, 2 rows affected (0.00 sec)
Records: 2 Duplicates: 0 Warnings: 0
mysql> select * from info;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
+----+-------+-------+
2 rows in set (0.00 sec)
mysql> select * from info limit 1;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
+----+-------+-------+
1 row in set (0.00 sec)
mysql> quit
Bye
[root@localhost ~]#
使用tar压缩data数据目录
[root@localhost ~]# cd /usr/local/mysql/
[root@localhost mysql]# ls
bin docs mysqld.pid README usr
COPYING include mysql.sock README-test
COPYING-test lib mysql.sock.lock share
data man mysql-test support-files
[root@localhost mysql]# cd data/
[root@localhost data]# ls
auto.cnf ib_buffer_pool ib_logfile0 ibtmp1 performance_schema sys
bbs ibdata1 ib_logfile1 mysql school
[root@localhost data]# cd school/
[root@localhost school]# ls
db.opt info.frm info.MYD info.MYI
[root@localhost school]# cd ..
[root@localhost data]# cd ..
[root@localhost mysql]# tar Jcvf /opt/mysql-$(date +%F).tar.xz /usr/local/mysql/data/
tar: Removing leading `/' from member names
/usr/local/mysql/data/
/usr/local/mysql/data/ibdata1
/usr/local/mysql/data/ib_logfile1
/usr/local/mysql/data/ib_logfile0
。。。。。
/usr/local/mysql/data/school/db.opt
/usr/local/mysql/data/school/info.frm
/usr/local/mysql/data/school/info.MYI
/usr/local/mysql/data/school/info.MYD
[root@localhost mysql]#
[root@localhost mysql]# ls /opt/
dir_SC_UTF8 mysql-5.7.20 php-7.1.10 说明.htm
mysql-2020-01-07.tar.xz nginx-1.12.2 rh
使用tar是进行物理上的备份
mysql自带的备份工具,相当方便对mysql进行备份
通过该命令工具可以将指定的库、表或全部的库导出为sql脚本,在需要恢复时可进行数据恢复
备注:使用tar命令
dump备份的意思
使用mysqldump需要注意权限问题,是否有权限进行操作
mysqdump -u 用户名 -p [密码] [选项] [数据库名] > /备份路径/备份文件名
单库备份举例
–all databases 选项
— databases; 添加多个数据库
[root@localhost mysql]# mysqldump -u root -p school > /opt/school.sql
Enter password:
[root@localhost mysql]# ls /opt/
dir_SC_UTF8 mysql-5.7.20 php-7.1.10 school.sql
mysql-2020-01-07.tar.xz nginx-1.12.2 rh 说明.htm
[root@localhost mysql]# cd /opt
[root@localhost opt]# ls school.sql
school.sql
[root@localhost opt]# vim school.sql
[root@localhost opt]#
mysqdump -u 用户名 -p [密码] [选项] --databases 库名1 [库名2]… > /备份路径/备份文件名
多库备份举例
[root@localhost opt]# mysql -uroot -p12341234
mysql: [Warning] Using a password on the command line interface can be insecure.
//此处警告密码暴露在命令行中
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 6
Server version: 5.7.20 Source distribution
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| bbs |
| mysql |
| performance_schema |
| school |
| sys |
+--------------------+
6 rows in set (0.00 sec)
//这里备份mysql和school数据库
mysql> quit
Bye
[root@localhost opt]# mysqldump -u root -p12341234 --databases school mysql > /opt/db_school_mysql.sql
mysqldump: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# vim /opt/db_school_mysql.sql
[root@localhost opt]#
–opt 固定语法参数,所有数据全部备份
[root@localhost opt]# mysqldump -uroot -p12341234 --opt --all-databases > /opt/all.sql
mysqldump: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# vim /opt/all.sql
[root@localhost opt]# mysqldump -uroot -p12341234 school info > /opt/school_info.sql
mysqldump: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# ls /opt/school_info.sql
/opt/school_info.sql
[root@localhost opt]# vim /opt/school_info.sql
[root@localhost opt]#
基于表结构的备份
[root@localhost opt]# mysqldump -uroot -p12341234 -d school info > /opt/school_infod.sql
mysqldump: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# vim /opt/school_infod.sql
[root@localhost opt]#
表结构的备份也是比较频繁的
使用musqldump命令导出的SQL备份脚本,在进行数据恢复时可使用以下方法导入
source 是在mysql模式下面使用
mysql是在linux模式下使用
备注:备份sql脚本的路径写绝对路径
恢复数据库,是恢复数据库里面的表,如果此时数据库也被删除,需要创建一个同名的数据库————仔细查看school.sql脚本,可以发现没有school数据库的操作
[root@localhost opt]# mysql -uroot -p
Enter password:
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| bbs |
| mysql |
| performance_schema |
| school |
| sys |
+--------------------+
6 rows in set (0.00 sec)
mysql> use school;
Database changed
mysql> drop table info;
Query OK, 1 row affected (0.01 sec)
mysql> show tables;
Empty set (0.00 sec)
mysql> source /opt/school.sql
Query OK, 0 rows affected (0.00 sec)
......
Query OK, 0 rows affected (0.00 sec)
mysql> show tables;
+------------------+
| Tables_in_school |
+------------------+
| info |
+------------------+
1 row in set (0.00 sec)
mysql> drop table info;
Query OK, 0 rows affected (0.00 sec)
mysql> show tables;
Empty set (0.00 sec)
mysql> quit
Bye
[root@localhost opt]#
[root@localhost opt]# mysql -uroot -p12341234 school < /opt/school.sql
mysql: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# mysql -uroot -p
Enter password:
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> show tables;
+------------------+
| Tables_in_school |
+------------------+
| info |
+------------------+
1 row in set (0.00 sec)
mysql> select * from info;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
+----+-------+-------+
2 rows in set (0.00 sec)
在生产环境中,可以使用shell脚本实现自动定期备份
mysql没有提供直接的增量备份方法
可以通过mysql提供的二进制文件(binary logs)间接实现增量备份
mysql二进制日志对备份的意义
二进制文件针对位置点、时间点进行有效的恢复
查看日志文件需要进行解码
就是将某个起始时间的二进制日志导入到数据库中,从而跳过某个发生错误的时间点实现数据的恢复
使用基于时间点的恢复,可能会出现在一个时间点里既同时存在正确的操作又存在错误的操作,所以我们需要一种更为精确的恢复方式
针对过程中的误操作备份,如何跳过误操作的方式————可以进行断点恢复
binlog 二进制文件
[root@localhost opt]# ls
all.sql mysql-5.7.20 school_infod.sql
db_school_mysql.sql nginx-1.12.2 school_info.sql
dir_SC_UTF8 php-7.1.10 school.sql
mysql-2020-01-07.tar.xz rh 说明.htm
[root@localhost opt]# rm -rf *.sql
[root@localhost opt]# ls
dir_SC_UTF8 mysql-5.7.20 php-7.1.10 说明.htm
mysql-2020-01-07.tar.xz nginx-1.12.2 rh
开启二进制日志功能,修改/etc/my.cnf文件,然后重启服务
[client]
port = 3306
default-character-set=utf8
socket = /usr/local/mysql/mysql.sock
[mysql]
port = 3306
default-character-set=utf8
socket = /usr/local/mysql/mysql.sock
[mysqld]
user = mysql
basedir = /usr/local/mysql
datadir = /usr/local/mysql/data
port = 3306
character_set_server=utf8
pid-file = /usr/local/mysql/mysqld.pid
socket = /usr/local/mysql/mysql.sock
'log-bin=mysql-bin
server-id = 1
default-storage-engine=Myisam
sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_AUTO_VALUE_ON_ZERO,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,PIPES_AS_CONCAT,ANSI_QUOTES
[root@localhost opt]# systemctl restart mysqld
查看二进制日志文件
[root@localhost opt]# cd /usr/local/mysql/
[root@localhost mysql]# cd data/
[root@localhost data]# ls
auto.cnf ibdata1 ibtmp1 mysql-bin.index sys
bbs ib_logfile0 mysql performance_schema
ib_buffer_pool ib_logfile1 'mysql-bin.000001' school
[root@localhost data]#
做增量备份前,要先进行一次完全备份
[root@localhost data]# mysqldump -uroot -p12341234 school > /opt/school.sql
mysqldump: [Warning] Using a password on the command line interface can be insecure.
[root@localhost data]# cd /opt
[root@localhost opt]# ls
dir_SC_UTF8 mysql-5.7.20 php-7.1.10 school.sql
mysql-2020-01-07.tar.xz nginx-1.12.2 rh 说明.htm
[root@localhost opt]# vim school.sql
接下来做增量备份,此时,之前的操作被存放到001当中,接下来的操作会被存放到002当中
[root@localhost opt]# mysqladmin -uroot -p12341234 flush-logs
mysqladmin: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# ls /usr/local/mysql/data/
auto.cnf ibdata1 ibtmp1 mysql-bin.000002 school
bbs ib_logfile0 mysql mysql-bin.index sys
ib_buffer_pool ib_logfile1 mysql-bin.000001 performance_schema
[root@localhost opt]#
进入数据库
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select * from info;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
+----+-------+-------+
2 rows in set (0.00 sec)
mysql> insert into info (name,score) values ('test01',66);
//这个是正常操作
Query OK, 1 row affected (0.00 sec)
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
| 3 | test01 | 66.0 |
+----+--------+-------+
3 rows in set (0.00 sec)
mysql> delete from info where name='stu01';
//误操作
Query OK, 1 row affected (0.01 sec)
mysql> insert into info (name,score) values ('test02',99);
//正常操作
Query OK, 1 row affected (0.01 sec)
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 4 | test02 | 99.0 |
| 2 | stu02 | 77.0 |
| 3 | test01 | 66.0 |
+----+--------+-------+
3 rows in set (0.01 sec)
mysql> quit
Bye
此时在不知情的情况下,进行增量备份,此时误操作写在了002中
[root@localhost opt]# mysqladmin -uroot -p12341234 flush-logs
mysqladmin: [Warning] Using a password on the command line interface can be insecure.
[root@localhost opt]# cd /usr/local/mysql/data/
[root@localhost data]# ls
auto.cnf ib_logfile0 mysql-bin.000001 performance_schema
bbs ib_logfile1 mysql-bin.000002 school
ib_buffer_pool ibtmp1 mysql-bin.000003 sys
ibdata1 mysql mysql-bin.index
查看日志文件
-v 显示内容在界面,–base64解码器 output输出 decode-rows 读取按行读取
[root@localhost data]# mysqlbinlog --no-defaults mysql-bin.000002
//查看二进制日志文件,不过可以发现看不懂
/*!50530 SET @@SESSION.PSEUDO_SLAVE_MODE=1*/;
/*!50003 SET @OLD_COMPLETION_TYPE=@@COMPLETION_TYPE,COMPLETION_TYPE=0*/;
DELIMITER /*!*/;
# at 4
//这个是位置点
#200107 16:54:11 server id 1 end_log_pos 123 CRC32 0x76a9dc26 Start: binlog v 4, server v 5.7.20-log created 200107 16:54:11
//这个是时间点
BINLOG '
M0cUXg8BAAAAdwAAAHsAAAAAAAQANS43LjIwLWxvZwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
AAAAAAAAAAAAAAAAAAAAAAAAEzgNAAgAEgAEBAQEEgAAXwAEGggAAAAICAgCAAAACgoKKioAEjQA
//像这样的就是被加密的命令
[root@localhost data]# mysqlbinlog --no-defaults --base64-output=decode-rows -v mysql-bin.000002 > /opt/back.txt
//-v 显示内容在界面,--base64解码器 output输出 decode-rows 读取按行读取
[root@localhost data]# cd /opt
[root@localhost opt]# vim back.txt
//下面的截图就是bak.txt中的数据信息
下面是错误操作截图
错误操作下面的一条正确命令
此时错误操作在中间,要把错误跳过
此时有两种恢复形式:时间和位置
时间点:
200107 16:57:56 --stop-datetime /指从这个日志文件开始,执行到这个时间点时就停止
200107 16:58:46 --start-datetime /指这个日志文件中,从这个时间点开始向后面执行
先完全备份恢复,source /opt/school.sql
[root@localhost opt]# mysql -uroot -p12341234
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> drop table info;
Query OK, 0 rows affected (0.01 sec)
mysql> select * from info;
ERROR 1146 (42S02): Table 'school.info' doesn't exist
mysql> show tables;
Empty set (0.00 sec)
mysql> source /opt/school.sql;
Query OK, 0 rows affected (0.00 sec)
。。。。。。
mysql> show tables;
+------------------+
| Tables_in_school |
+------------------+
| info |
+------------------+
1 row in set (0.00 sec)
mysql> select * from info;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
+----+-------+-------+
2 rows in set (0.00 sec)
mysql>
mysql> quit
Bye
然后再增量恢复,即时间上的断点恢复
[root@localhost opt]# mysqlbinlog --no-defaults --stop-datetime='2020-01-07 16:57:56' /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
Enter password:
[root@localhost opt]# mysql -uroot -p12341234
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 9
Server version: 5.7.20-log Source distribution
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
| 3 | test01 | 66.0 |
+----+--------+-------+
3 rows in set (0.00 sec)
mysql> quit
Bye
[root@localhost opt]# mysqlbinlog --no-defaults --start-datetime='2020-01-07 16:58:46' /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
Enter password:
[root@localhost opt]# mysql -uroot -p12341234
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 11
Server version: 5.7.20-log Source distribution
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
| 3 | test01 | 66.0 |
| 4 | test02 | 99.0 |
+----+--------+-------+
4 rows in set (0.00 sec)
//误操作删除的stu01 没有被删掉
mysql>
以上就是基于时间点的恢复
接下来演示基于位置的恢复
mysql> delete from info where name='test01';
Query OK, 1 row affected (0.00 sec)
mysql> delete from info where name='test02';
Query OK, 1 row affected (0.00 sec)
mysql> select * from info;
+----+-------+-------+
| id | name | score |
+----+-------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
+----+-------+-------+
2 rows in set (0.01 sec)
mysql> quit
Bye
[root@localhost opt]#
[root@localhost opt]# cd /opt
[root@localhost opt]# ls
back.txt mysql-2020-01-07.tar.xz nginx-1.12.2 rh 说明.htm
dir_SC_UTF8 mysql-5.7.20 php-7.1.10 school.sql
[root@localhost opt]# vim back.txt
下面是误操作位置截图,其中
667是误操作,所以是到612为止 --stop-position 是恢复到这个位置点为止
716开始 --start-position 是从这个位置点起开始恢复
[root@localhost opt]# mysqlbinlog --no-defaults --stop-postion='612' /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
mysqlbinlog: [ERROR] unknown variable 'stop-postion=612'
Enter password:
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
[root@localhost opt]# mysqlbinlog --no-defaults --stop-position='612' /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
Enter password:
[root@localhost opt]# mysql -uroot -p12341234
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 14
Server version: 5.7.20-log Source distribution
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
| 3 | test01 | 66.0 |
+----+--------+-------+
3 rows in set (0.00 sec)
mysql> quit
Bye
[root@localhost opt]# mysqlbinlog --no-defaults --start-position='716' /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
Enter password:
[root@localhost opt]# mysql -uroot -p12341234mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 16
Server version: 5.7.20-log Source distribution
Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql> use school;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql> select * from info;
+----+--------+-------+
| id | name | score |
+----+--------+-------+
| 1 | stu01 | 88.0 |
| 2 | stu02 | 77.0 |
| 4 | test02 | 99.0 |
| 3 | test01 | 66.0 |
+----+--------+-------+
4 rows in set (0.00 sec)
mysql> desc info;
+-------+--------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+-------+--------------+------+-----+---------+----------------+
| id | int(4) | NO | PRI | NULL | auto_increment |
| name | varchar(10) | NO | | NULL | |
| score | decimal(4,1) | NO | | NULL | |
+-------+--------------+------+-----+---------+----------------+
3 rows in set (0.00 sec)
mysql> quit
Bye
[root@localhost opt]# mysqlbinlog --no-defaults /usr/local/mysql/data/mysql-bin.000002 | mysql -u root -p
//这个是增量恢复,将日志文件内的所有操作全部执行