pt-query-digest分析mysql(mariadb)数据库慢查询日志(slow_query_log)详述

案例1:pt-query-digest综合分析返回值

[root@iZ25ja2kaemZ ~]# pt-query-digest /var/run/mysqld/mysqld-slow.log

# 400ms user time, 20ms system time, 26.45M rss, 212.00M vsz
# Current date: Sat Sep  3 16:59:25 2016
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log【第一部分为总体分析】
# Overall: 408 total, 25 unique, 0.00 QPS, 0.00x concurrency ____【wyq:Overall: 总共有多少条查询,上例为总共 408个查询,将其抽象为25个独立查询(即将408条查询分为25类,每个类查询格式相似或一样)】
# Time range: 2016-09-01 22:06:01 to 2016-09-03 13:19:24 【这些慢查询记录的时间范围,Time range: 查询执行的时间范围
# Attribute          total     min     max     avg     95%  stddev  median  ( total 总计,min:最小 max: 最大 avg:平均 95%: 把所有值从小到大排列,位置位于95%的那个数,这个数一般最具有参考价值;stddev:标准差,该值给出各个统计数据相对于avg平均值的离散程度,数值越大说明研究的数据样本相对于平均值离散程度越大。一般来讲如果这些样本数据符合正太分布(实际可能符合也可能不符合,但是正太分布的规律有一定参考价值),那么我们有在正态分布中,均值+/-一个标准差范围所占比率为全部数值之68%。对于正态分布,两个标准差之内的比率合起来为95%。对于正态分布,正负三个标准差之内的比率合起来为99%;median: 中位数,把所有值从小到大排列,位置位于中间那个数)
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time             5s     4us      2s    11ms    34ms   109ms   384us 【慢查询日志中总共记录的慢查询耗时总数为5秒,其中最慢的一次查询耗时2s,最快的一次查询耗时4us,所有记录的查询中平均每次查询耗时11ms,95%左右的查询都小于或等于34ms。】
# Lock time           75ms       0    34ms   183us    73us     2ms       0【锁定时间】
# Rows sent        224.25k       0  15.67k  562.82  964.41   2.49k    4.96【发送行数,如果发送行数远远小于查询行数,那么说明我们建立的索引不是太好,一般来讲索引建立的越好,那么发送行数与扫描行数越接近】
# Rows examine     274.12k       0  15.67k  687.98   2.89k   2.78k    9.83【扫描行数】
# Query size        22.68k      19     484   56.93  151.03   41.13   51.63 【查询语句总大小k为千字节,如一个查询语句"SELECT * FROM `TABLES` LIMIT 0, 1000"共计36个字母或数字或符号,即计算为36个字节,我们这里的22.68k字节是所有的本次统计的查询记录所有查询语句长度累加起来的总字节数。】

 [第二部分为对查询进行参数化并分组,即对查询语句类似的查询归为一类,然后对各类查询的执行情况进行分析,结果按总执行时长,从大到小排序。

Rank          The query's rank within the entire set of queries analyzed
        Query ID      The query's fingerprint
        Response time The total response time, and percentage of overall total
总的响应时

        Calls         The number of times this query was executed 执行次数,即本次分析总共有多少条这种类型的查询语句。

        R/Call        The mean response time per execution 平均每次执行的响应时间。

        V/M           The Variance-to-mean ratio of response time 方差/均值,方差除以平均值,称为离散指数,值越大说明这条语句执行越不稳定,需要关注。关于方差,在数学上是个重要的概念,是分析正太分布的重要参数。

        Item          The distilled query  抽象化的对象

 

 

]

# Profile
# Rank Query ID                    Response   time    Calls    R/Call   V/M          Item 

# ==== ================== ============= ===== ====== =====
#    1   0x67A347A2812914DF    4.1590   88.9%   252   0.0165    1.16         SELECT dede_addonarticle
#    2   0x19EE5F8E296E4E3D    0.3294   7.0%    22 0.  0150       0.02         SELECT payment
# MISC 0xMISC              0.1892  4.0%   134 0.0014   0.0 <23 ITEMS>

第三部分:每一种查询的详细统计结果,即上面第二部分的详细表述

# Query 1: 19.38 QPS, 0.32x concurrency, ID 0x67A347A2812914DF at byte 36459
# This item is included in the report because it matches --limit.
# Scores: V/M = 1.16
# Time range: 2016-09-02 21:00:02 to 21:00:15
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======

# Count         61     252  [wyq:该条(抽象)语句总共执行了252次记录,占总log文件记录条数的61%。
]
# Exec time     88      4s    78us      2s    17ms    31ms   138ms     1ms【wyq该条(抽象)语句的所有执行次数的总共执行时间为4s,占有总log文件分析中总时间的88%,显然这种执行时间长,占比大的语句时我们优化的目的语句】

# Lock time      0       0       0       0       0       0       0       0 【锁定时间】
# Rows sent     39  88.32k       0  15.67k  358.90  592.07   1.66k    6.98【实际搜索到的结果行数,该抽象查询占总统计记录的39%】
# Rows examine  32  88.32k       0  15.67k  358.90  592.07   1.66k    6.98【扫描的行数,该抽象查询占总统计记录的32%】
# Query size    59  13.46k      43      71   54.69   59.77    4.20   54.21【该抽象查询语句的总字符数数据量k为千字节,该抽象查询占总统计记录的59%】
# String:
# Databases    web (140/55%), dedeini (44/17%)... 5 more 【库名】
# Hosts        localhost  #一般为当前服务器的主机名
# Users        root #当前服务器登录者的用户名
# Query_time distribution 查询时间分布, 长短体现区间占比,本例中1s-10s之间查询数量是10s上的二分之一,第一行为1us-10us(不包括10us本身,第二行为10us-100us区间的占比。】
#   1us
#  10us  ##
# 100us  ########
#   1ms  #######
#  10ms  ###########
# 100ms  #
#    1s   ########
#  10s+ ################
# Tables   [查询中涉及到的表]
#    SHOW TABLE STATUS FROM `flower` LIKE 'dede_addonarticle'\G
#    SHOW CREATE TABLE `flower`.`dede_addonarticle`\G
SELECT /*!40001 SQL_NO_CACHE */ * FROM `dede_addonarticle`\G
# Converted for EXPLAIN
# EXPLAIN /*!50100 PARTITIONS*/
SELECT /*!40001 SQL_NO_CACHE */ * FROM `dede_addonarticle`\G  [wyq:当前抽象化的查询语句]

# Query 2: 0.01 QPS, 0.00x concurrency, ID 0x19EE5F8E296E4E3D at byte 7811
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.02
# Time range: 2016-09-01 22:17:33 to 23:27:05
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          5      22
# Exec time      7   329ms   209us    44ms    15ms    42ms    19ms   301us
# Lock time      2     2ms    68us    88us    73us    76us     5us    69us
# Rows sent     53 119.58k       1  15.67k   5.44k  15.20k   6.98k   13.83
# Rows examine  43 119.58k       1  15.67k   5.44k  15.20k   6.98k   13.83
# Query size     3     703      30      36   31.95   34.95    2.01   30.19
# String:
# Databases    sakila
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us  ################################################################
#   1ms  ####
#  10ms  #######################################
# 100ms

#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `sakila` LIKE 'payment'\G
#    SHOW CREATE TABLE `sakila`.`payment`\G
# EXPLAIN /*!50100 PARTITIONS*/
select * from payment limit 50000\G

[root@iZ25ja2kaemZ ~]#
案例 2:--limit 应用,仅仅打印总抽象化分组后的前面3个。

[root@iZ25ja2kaemZ ~]# pt-query-digest --limit 3   /var/run/mysqld/mysqld-slow.log#可以看到下面总共5 unique分析结果数据,我们取出前面的3条分析结果。

# 240ms user time, 10ms system time, 24.52M rss, 205.19M vsz
# Current date: Sat Sep  3 17:58:45 2016
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 9 total, 5 unique, 0.05 QPS, 0.00x concurrency ________________
# Time range: 2016-09-03 17:07:47 to 17:11:03
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time           96ms   207us    40ms    11ms    40ms    16ms   236us
# Lock time          672us    68us    85us    74us    84us     6us    73us
# Rows sent         31.47k       2  15.67k   3.50k  15.20k   6.31k    3.89
# Rows examine      31.47k       2  15.67k   3.50k  15.20k   6.31k    3.89
# Query size           302      19      49   33.56   46.83   12.98   28.75

# Profile
# Rank Query ID           Response time Calls R/Call V/M   Item
# ==== ================== ============= ===== ====== ===== ==============
#    1 0x528FB5BA9A8EE134  0.0790 82.6%     2 0.0395  0.00 SELECT rental
#    2 0x7726C04443A49C26  0.0152 15.9%     1 0.0152  0.00 SELECT country
#    3 0x651F0078A1D623D4  0.0010  1.0%     4 0.0002  0.00 SELECT rental
# MISC 0xMISC              0.0004  0.4%     2 0.0002   0.0 <2 ITEMS>

# Query 1: 0.02 QPS, 0.00x concurrency, ID 0x528FB5BA9A8EE134 at byte 585
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: 2016-09-03 17:08:10 to 17:09:58
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         22       2
# Exec time     82    79ms    39ms    40ms    39ms    40ms   387us    39ms
# Lock time     22   152us    68us    84us    76us    84us    11us    76us
# Rows sent     99  31.34k  15.67k  15.67k  15.67k  15.67k       0  15.67k
# Rows examine  99  31.34k  15.67k  15.67k  15.67k  15.67k       0  15.67k
# Query size    13      40      20      20      20      20       0      20
# String:
# Databases    sakila
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `sakila` LIKE 'rental'\G
#    SHOW CREATE TABLE `sakila`.`rental`\G
# EXPLAIN /*!50100 PARTITIONS*/
select * from rental\G

# Query 2: 0 QPS, 0x concurrency, ID 0x7726C04443A49C26 at byte 0 ________
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: all events occurred at 2016-09-03 17:07:47
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         11       1
# Exec time     15    15ms    15ms    15ms    15ms    15ms       0    15ms
# Lock time     10    71us    71us    71us    71us    71us       0    71us
# Rows sent      0     109     109     109     109     109       0     109
# Rows examine   0     109     109     109     109     109       0     109
# Query size     6      21      21      21      21      21       0      21
# String:
# Databases    sakila
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `sakila` LIKE 'country'\G
#    SHOW CREATE TABLE `sakila`.`country`\G
# EXPLAIN /*!50100 PARTITIONS*/
select * from country\G

# Query 3: 0.31 QPS, 0.00x concurrency, ID 0x651F0078A1D623D4 at byte 1615
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: 2016-09-03 17:10:50 to 17:11:03
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         44       4
# Exec time      1   970us   235us   257us   242us   247us     9us   242us
# Lock time     46   313us    75us    85us    78us    84us     4us    80us
# Rows sent      0      26       4      14    6.50   13.83    4.30    3.89
# Rows examine   0      26       4      14    6.50   13.83    4.30    3.89
# Query size    63     193      48      49   48.25   46.83       0   46.83
# String:
# Databases    sakila
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us  ################################################################
#   1ms
#  10ms
# 100ms
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `sakila` LIKE 'rental'\G
#    SHOW CREATE TABLE `sakila`.`rental`\G
# EXPLAIN /*!50100 PARTITIONS*/
select * from rental order by rental_id  limit 14\G
案例 3:--group-by 按照表来分析数据并排序查询,取出分析结果的前3条数据。

 

[root@iZ25ja2kaemZ ~]#  pt-query-digest --limit 3  --group-by tables  /var/run/mysqld/mysqld-slow.log

# 6.5s user time, 50ms system time, 33.46M rss, 214.19M vsz
# Current date: Tue Mar  3 18:16:04 2020
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 22.82k total, 463 unique, 0.00 QPS, 0.00x concurrency _________
# Time range: 2019-05-14 02:12:15 to 2020-03-03 18:08:21
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time           863s    43us     14s    38ms    75ms   230ms    16ms
# Lock time            43s       0   850ms     2ms     2ms    16ms    98us
# Rows sent        723.86k       0   4.51k   32.47   24.84  277.42    0.99
# Rows examine      11.09M       0 345.12k  509.59  223.14   6.20k    4.96
# Query size         6.47M      20  42.96k  297.45  652.75  904.21   97.36

# Profile
# Rank Query ID Response time  Calls R/Call V/M   Item
# ==== ======== ============== ===== ====== ===== ========================
#    1 0x        97.3616 11.3%    72 1.3522  2.78 shangqiao.qiaoyixinli
#    2 0x        96.7103 11.2%  4634 0.0209  0.04 information_schema.triggers
#    3 0x        37.4393  4.3%   464 0.0807  2.16 wyq.while_rep
#   21 0x         9.6697  1.1%    20 0.4835  2.89 weiyinqingnew.ims_wechat_news
#   40 0x         5.1931  0.6%    19 0.2733  1.15 weiyinqingqiang.ims_core_cache
# MISC 0xMISC   617.1089 71.5% 17616 0.0350   0.0 <458 ITEMS>

# ########################################################################
# Report grouped by tables
# ########################################################################

# Item 1: 0.00 QPS, 0.00x concurrency, ID 0x8994EAC6F931830A at byte 1181361
# Scores: V/M = 2.78
# Time range: 2019-07-10 20:07:56 to 2019-07-25 07:49:55
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      72
# Exec time     11     97s    11ms     10s      1s      4s      2s   266ms
# Lock time      0     5ms       0   124us    70us    93us    22us    73us
# Rows sent      5  40.29k       0    1000  573.03  964.41  428.82  918.49
# Rows examine   6 729.98k       0 345.12k  10.14k  11.91k  45.78k  964.41
# Query size     0  10.67k      41   2.87k  151.76  271.23  334.27   80.10
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (35/48%), localhost (15/20%)... 4 more
# Users        1593356863... (57/79%), root (15/20%)
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  #########################################
# 100ms  ################################################################
#    1s  ##################################################
#  10s+  ##
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
shangqiao.qiaoyixinli

# Item 2: 0.00 QPS, 0.00x concurrency, ID 0x3733B3F3ECBC932F at byte 388392
# Scores: V/M = 0.04
# Time range: 2019-05-14 12:04:53 to 2020-02-05 07:43:53
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         20    4634
# Exec time     11     97s    11ms   865ms    21ms    36ms    27ms    17ms
# Lock time      3      2s   130us    66ms   370us   424us     1ms   301us
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size    15   1.02M     209     253  230.67  234.30    7.84  223.14
# String:
# Databases    zhaopin (1077/23%), wyq (697/15%)... 9 more
# Hosts        114.249.118.195 (1151/24%)... 30 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  #
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `information_schema` LIKE 'triggers'\G
#    SHOW CREATE TABLE `information_schema`.`triggers`\G
information_schema.triggers

# Item 3: 0.00 QPS, 0.00x concurrency, ID 0x3F3B4344E4284AB1 at byte 5460841
# Scores: V/M = 2.16
# Time range: 2019-05-14 12:05:37 to 2020-03-03 15:43:01
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          2     464
# Exec time      4     37s   945us      6s    81ms   148ms   417ms    20ms
# Lock time      0   423ms    19us    56ms   910us   626us     6ms    60us
# Rows sent     41 298.25k       0   4.51k  658.21   3.88k   1.28k   14.52
# Rows examine  17   1.99M       0  11.68k   4.38k  10.80k   2.83k   4.49k
# Query size     1  77.38k      23     390  170.76  313.99   96.33  158.58
# String:
# Databases    wyq
# Hosts        localhost (416/89%), 114.249.113.5 (12/2%)... 14 more
# Users        root (416/89%), 1593356863... (48/10%)
# Query_time distribution
#   1us
#  10us
# 100us  #
#   1ms  #################
#  10ms  ################################################################
# 100ms  #####
#    1s  #
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `wyq` LIKE 'while_rep'\G
#    SHOW CREATE TABLE `wyq`.`while_rep`\G
wyq.while_rep

# Item 21: 0.00 QPS, 0.00x concurrency, ID 0x66D4F21B5813BAE5 at byte 3437201
# Scores: V/M = 2.89
# Time range: 2019-05-17 00:45:56 to 2020-02-21 00:28:44
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      20
# Exec time      1     10s    13ms      4s   483ms      4s      1s    34ms
# Lock time      0    41ms    23us    26ms     2ms     7ms     5ms   247us
# Rows sent      0     141       0      23    7.05   22.53    7.30    3.89
# Rows examine   0     176       4      23    8.80   22.53    6.25    6.98
# Query size     0   1.70k      31     299   86.90  284.79   70.63   84.10
# String:
# Databases    weiyinqingnew
# Hosts        localhost (12/60%), 124.64.18.177 (5/25%)... 3 more
# Users        admin (12/60%), 1593356863... (8/40%)
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  ##################
#    1s  #########
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weiyinqingnew` LIKE 'ims_wechat_news'\G
#    SHOW CREATE TABLE `weiyinqingnew`.`ims_wechat_news`\G
weiyinqingnew.ims_wechat_news

# Item 40: 0.00 QPS, 0.00x concurrency, ID 0xD265237295CAA2F8 at byte 4502730
# Scores: V/M = 1.15
# Time range: 2019-05-16 20:07:29 to 2019-12-24 14:03:36
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      19
# Exec time      0      5s    14ms      2s   273ms      2s   560ms    56ms
# Lock time      0    31ms    25us    30ms     2ms   185us     7ms    69us
# Rows sent      0     506       0      75   26.63   72.65   28.12    0.99
# Rows examine   0     506       0      75   26.63   72.65   28.12    0.99
# Query size     0   1.11k      30      81   59.95   76.28   18.37   72.65
# String:
# Databases    weiyinqingqiang
# Hosts        localhost (10/52%), 114.242.250.236 (4/21%)... 3 more
# Users        admin (10/52%), 1593356863... (9/47%)
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  ###################
#    1s  #########
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weiyinqingqiang` LIKE 'ims_core_cache'\G
#    SHOW CREATE TABLE `weiyinqingqiang`.`ims_core_cache`\G
weiyinqingqiang.ims_core_cache
[root@iZ25ja2kaemZ ~]#

案例 4  --since  按照时间,最近12h,单位可以是h,s等 ,--until  参数值可以直接是日期时间格式

 [root@iZ25ja2kaemZ ~]#pt-query-digest --limit 8  --since 12h    /var/run/mysqld/mysqld-slow.log
[root@iZ25ja2kaemZ ~]# pt-query-digest --since '2020-01-07 09:30:00' --until '2020-01-17 10:00:00'  --limit 1 /var/run/mysqld/mysqld-slow.log 

 

# 2.5s user time, 70ms system time, 26.45M rss, 207.21M vsz
# Current date: Tue Mar  3 19:13:09 2020
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 534 total, 133 unique, 0.00 QPS, 0.00x concurrency ____________
# Time range: 2020-01-07 10:15:04 to 2020-01-17 09:11:49
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time            32s    10ms      6s    60ms   122ms   282ms    27ms
# Lock time             1s       0   139ms     2ms     2ms    11ms    69us
# Rows sent         87.52k       0   3.91k  167.83  964.41  674.59    3.89
# Rows examine     668.77k       0  26.63k   1.25k   4.95k   3.93k    7.70
# Query size        61.45k      14   1.49k  117.84  329.68  172.31   44.60

 

# Profile
# Rank Query ID           Response time Calls R/Call V/M   Item
# ==== ================== ============= ===== ====== ===== ===============
#    1 0x476A95D312083789  8.1589 25.3%    12 0.6799  4.30 SELECT while_rep
# MISC 0xMISC             24.0484 74.7%   522 0.0461   0.0 <132 ITEMS>

 

# Query 1: 0.00 QPS, 0.00x concurrency, ID 0x476A95D312083789 at byte 5460841
# This item is included in the report because it matches --limit.
# Scores: V/M = 4.30
# Time range: 2020-01-08 19:24:03 to 2020-01-16 15:30:31
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          2      12
# Exec time     25      8s    29ms      6s   680ms   339ms      2s   148ms
# Lock time      0     1ms    68us   155us    87us    93us    22us    80us
# Rows sent     13  11.72k    1000    1000    1000    1000       0    1000
# Rows examine   8  58.88k   4.84k   4.95k   4.91k   4.95k   55.50   4.95k
# Query size     1     696      58      58      58      58       0      58
# String:
# Databases    wyq
# Hosts        114.249.113.5 (7/58%), 114.249.119.32 (5/41%)
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  #####################################################
# 100ms  ################################################################
#    1s  ##########
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `wyq` LIKE 'while_rep'\G
#    SHOW CREATE TABLE `wyq`.`while_rep`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `while_rep` ORDER BY `id` DESC LIMIT 0, 1000\G

#

案例5.1   --order-by  分析结果排序,可以按照count执行次数从大到小排序,默认值为按照查询时间从大到小排序。

          Aggregate Meaning Query_time:sum
              ========= ============================
              sum       Sum/total attribute value ,排序数值参见下面红色字体标记。
              min       Minimum attribute value,排序数值参见下面红色字体标记。
              max       Maximum attribute value,排序数值参见下面红色字体标记。
              cnt       Frequency/count of the query,排序数值参见下面红色字体标记。

 

# Query 3: 0 QPS, 0x concurrency, ID 0xCEF2FE22D940E046 at byte 5756079 __
# Scores: V/M = 0.00
# Time range: all events occurred at 2020-02-07 20:23:39
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      
1(cnt)
# Exec time      1      9s(sum)      9s(min)      9s(max)      9s      9s       0      9s
# Lock time      0   102us   102us   102us   102us   102us       0   102us
# Rows sent      0    1000    1000    1000    1000    1000       0    1000
# Rows examine   0    1000    1000    1000    1000    1000       0    1000
# Query size     0      36      36      36      36      36       0      36
# String:
# Databases    information_schema
# Hosts        183.197.37.189
# Users        15933568633
# Query_time distribution

 

根据你要分析的日志的类型,我们的attributes的值是不同的,比如日志中记录了,比如我们看下面的mys

ql的慢查询日志的记录格式,该格式有键值对Query_timeLock_timeRows_sentRows_examined( Query_time: 0.024078  Lock_time: 0.000033 Rows_sent: 1  Rows_examined: 344
)
记录,因此我

们认为上述4个就是针对该格式日志的attribute,我们可以根据这些类型进行排序等。比如按照放行数的最大值从大到小

分类排序:pt-query-digest --order-by:Rows_sent --limit 5 /tmp/abc.log.(注意attributes的大小写,必须linux

是区分大小写的。

这四个attribute可以与sum,max,min组合,排序,这样我们有12种组合)

pt-query-digest --order-by Lock_time:sum --limit 5 /var/run/mysqld/mysqld-slow.log 
pt-query-digest --order-by
Rows_examined:sum --limit 5 /var/run/mysqld/mysqld-slow.log

[root@iZ25ja2kaemZ ~]# pt-query-digest --limit 5 --order-by Query_time:sum  /var/run/mysqld/mysqld-slow.log

 

# 5.7s user time, 50ms system time, 38.01M rss, 218.76M vsz
# Current date: Tue Mar  3 17:43:32 2020
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 22.66k total, 810 unique, 0.00 QPS, 0.00x concurrency _________
# Time range: 2019-05-14 02:12:14 to 2020-03-03 17:30:00
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time           941s    43us     14s    42ms    82ms   235ms    17ms
# Lock time            37s       0   850ms     2ms     2ms    14ms    98us
# Rows sent        550.42k       0   4.51k   24.87   28.75  218.93    0.99
# Rows examine       7.95M       0 345.12k  367.99  183.58   4.33k    3.89
# Query size         6.07M      11  42.96k  280.68  652.75  906.82   92.72

 

# Profile
# Rank Query ID           Response time  Calls R/Call V/M   Item
# ==== ================== ============== ===== ====== ===== ==============
#    1 0xF382DCE6D809E44D  96.7103 10.3%  4634 0.0209  0.04 SELECT information_schema.triggers
#    2 0x99AA0165670CE848  69.0287  7.3%   562 0.1228  1.09 ADMIN PREPARE
#    3 0xBFBEAB2DCE0C7048  46.1048  4.9%    21 2.1955  2.06 SELECT qiaoyixinli
#    4 0x79F0E996230BE344  43.0752  4.6%    12 3.5896  1.02 SELECT qiaoyixinli
#    5 0x4D41CF9302FA6F8F  33.7322  3.6%    25 1.3493  1.47 SELECT ims_core_cache
#    7 0xCF7D6B8416942E54  21.1302  2.2%   177 0.1194  1.06 SELECT cmf_portal_post cmf_portal_category_post
#   14 0x79E1C8DA3A31C630  11.9477  1.3%    12 0.9956  2.05 SELECT ims_wechat_news
# MISC 0xMISC             619.6322 65.8% 17222 0.0360   0.0 <803 ITEMS>

 

# Query 1: 0.00 QPS, 0.00x concurrency, ID 0xF382DCE6D809E44D at byte 388392
# Scores: V/M = 0.04
# Time range: 2019-05-14 12:04:53 to 2020-02-05 07:43:53
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         20    4634
# Exec time     10     97s    11ms   865ms    21ms    36ms    27ms    17ms
# Lock time      4      2s   130us    66ms   370us   424us     1ms   301us
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size    16   1.02M     209     253  230.67  234.30    7.84  223.14
# String:
# Databases    zhaopin (1077/23%), wyq (697/15%)... 9 more
# Hosts        114.249.118.195 (1151/24%)... 30 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  #
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `information_schema` LIKE 'triggers'\G
#    SHOW CREATE TABLE `information_schema`.`triggers`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT trigger_name, event_manipulation, event_object_table, action_statement, action_timing, DEFINER FROM information_schema.triggers WHERE BINARY event_object_schema='wyq' AND BINARY event_object_table='caiwu_cat'\G

 

# Query 2: 0.00 QPS, 0.00x concurrency, ID 0x99AA0165670CE848 at byte 5486302
# Scores: V/M = 1.09
# Time range: 2019-05-14 02:56:36 to 2020-03-01 08:48:33
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          2     562
# Exec time      7     69s    10ms      2s   123ms   208ms   366ms    28ms
# Lock time      0       0       0       0       0       0       0       0
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size     0  16.46k      30      30      30      30       0      30
# String:
# Databases    thinkcmfww... (366/65%), servercmf (102/18%)... 3 more
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  #########
#    1s  ##
#  10s+
administrator command: Prepare\G

 

# Query 3: 0.00 QPS, 0.00x concurrency, ID 0xBFBEAB2DCE0C7048 at byte 1181361
# Scores: V/M = 2.06
# Time range: 2019-07-11 01:50:13 to 2019-07-25 07:48:51
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      21
# Exec time      4     46s   212ms     10s      2s      4s      2s      2s
# Lock time      0     2ms    66us    95us    76us    84us     8us    69us
# Rows sent      1  10.64k     125    1000  519.05  964.41  328.11  363.48
# Rows examine   0  57.63k     250  27.75k   2.74k   8.06k   5.92k  719.66
# Query size     0   1.23k      60      60      60      60       0      60
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (16/76%), 114.242.250.169 (2/9%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms  ##########################################
#    1s  ################################################################
#  10s+  #####
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` ORDER BY `id` DESC LIMIT 0, 1000\G

 

# Query 4: 0.00 QPS, 0.00x concurrency, ID 0x79F0E996230BE344 at byte 1181116
# Scores: V/M = 1.02
# Time range: 2019-07-11 01:45:01 to 2019-07-25 07:48:32
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      12
# Exec time      4     43s    91ms      8s      4s      4s      2s      4s
# Lock time      0   916us    63us   103us    76us    93us    13us    73us
# Rows sent      1   9.96k     125    1000  849.50  964.41  311.65  964.41
# Rows examine   0   9.96k     125    1000  849.50  964.41  311.65  964.41
# Query size     0     492      41      41      41      41       0      41
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (6/50%), 114.242.250.169 (3/25%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ######
# 100ms  ######
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` LIMIT 0, 1000\G

 

# Query 5: 0.00 QPS, 0.00x concurrency, ID 0x4D41CF9302FA6F8F at byte 676598
# Scores: V/M = 1.47
# Time range: 2019-05-16 18:07:27 to 2019-12-24 14:03:36
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      25
# Exec time      3     34s    80ms      6s      1s      3s      1s   609ms
# Lock time      0     4ms    58us   357us   170us   224us    61us   176us
# Rows sent      0   1.86k      35     157   76.12  143.84   38.45   54.21
# Rows examine   0   1.86k      35     157   76.12  143.84   38.45   54.21
# Query size     0     750      30      30      30      30       0      30
# String:
# Databases    weiyinqing... (5/20%), zhaopin (5/20%)... 5 more
# Hosts        114.249.118.195 (7/28%)... 7 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ####
# 100ms  ################################################################
#    1s  #############################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weixindrkdpk` LIKE 'ims_core_cache'\G
#    SHOW CREATE TABLE `weixindrkdpk`.`ims_core_cache`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `ims_core_cache`\G

 

# Query 7: 0.00 QPS, 0.00x concurrency, ID 0xCF7D6B8416942E54 at byte 5495272
# Scores: V/M = 1.06
# Time range: 2019-05-14 02:56:36 to 2020-03-03 13:17:38
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0     177
# Exec time      2     21s   152us      2s   119ms      1s   355ms    21ms
# Lock time      8      3s    10us   308ms    17ms   189ms    65ms    11us
# Rows sent      0     177       1       1       1       1       0       1
# Rows examine   0  25.43k      15     207  147.10  202.40   64.34  151.03
# Query size     0  33.71k     195     195     195     195       0     195
# String:
# Databases    thinkcmfww... (103/58%), servercmf (41/23%)... 1 more
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us  #################################
#   1ms  #
#  10ms  ################################################################
# 100ms
#    1s  #######
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `thinkcmfwww` LIKE 'cmf_portal_post'\G
#    SHOW CREATE TABLE `thinkcmfwww`.`cmf_portal_post`\G
#    SHOW TABLE STATUS FROM `thinkcmfwww` LIKE 'cmf_portal_category_post'\G
#    SHOW CREATE TABLE `thinkcmfwww`.`cmf_portal_category_post`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT COUNT(*) AS tp_count FROM `cmf_portal_post` `pp` LEFT JOIN `cmf_portal_category_post` `pcp` ON `pp`.`id`=`pcp`.`post_id` WHERE  `pp`.`post_type` = '1'  AND `pp`.`post_status` = '1' LIMIT 1\G

 

# Query 14: 0.00 QPS, 0.00x concurrency, ID 0x79E1C8DA3A31C630 at byte 3437201
# Scores: V/M = 2.05
# Time range: 2019-05-16 18:07:31 to 2019-12-24 14:03:50
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      12
# Exec time      1     12s    54ms      4s   996ms      4s      1s   219ms
# Lock time      0     2ms    59us   281us   190us   260us    61us   204us
# Rows sent      0     137       2      23   11.42   22.53    6.87    8.91
# Rows examine   0     137       2      23   11.42   22.53    6.87    8.91
# Query size     0     372      31      31      31      31       0      31
# String:
# Databases    weiyinqing... (5/41%), weiyinqing (4/33%)... 2 more
# Hosts        124.64.18.177 (6/50%), 114.249.114.179 (3/25%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ###################################################
# 100ms  ################################################################
#    1s  ######################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weiyinqingnew` LIKE 'ims_wechat_news'\G
#    SHOW CREATE TABLE `weiyinqingnew`.`ims_wechat_news`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `ims_wechat_news`\G

案例5.2:相似语句抽象化分类后,按照各个分类中的消耗时间最大值排序,之后用grep或awk等命令,根据最大消耗时间的语句进行在慢查询文件中筛选,就可以找到具体相关语句的位置,从而获取更详细的如执行时间等参数。

 

[root@iZ25ja2kaemZ ~]#  pt-query-digest   --order-by query_time:max /var/run/mysqld/mysqld-slow.log
--order-by attribute query_time doesn't exist, using Query_time:sum

 

# 5.7s user time, 50ms system time, 38.00M rss, 218.77M vsz
# Current date: Tue Mar  3 19:27:31 2020
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 22.76k total, 810 unique, 0.00 QPS, 0.00x concurrency _________
# Time range: 2019-05-14 02:12:14 to 2020-03-03 18:42:04
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time           941s    43us     14s    41ms    82ms   234ms    17ms
# Lock time            37s       0   850ms     2ms     2ms    14ms    98us
# Rows sent        550.78k       0   4.51k   24.78   28.75  218.45    0.99
# Rows examine       8.12M       0 345.12k  373.85  183.58   4.34k    3.89
# Query size         6.11M      11  42.96k  281.44  652.75  909.11   92.72

 

 

 

# Profile
# Rank Query ID           Response time  Calls R/Call  V/M   Item
# ==== ================== ============== ===== ======= ===== =============
#    1 0x4D8A09430936693B  14.3093  1.5%     1 14.3093  0.00 SELECT shangqiao
#    2 0xBFBEAB2DCE0C7048  46.1048  4.9%    21  2.1955  2.06 SELECT qiaoyixinli
#    3 0xCEF2FE22D940E046   9.4689  1.0%     1  9.4689  0.00 SELECT TABLES
#    4 0x79F0E996230BE344  43.0752  4.6%    12  3.5896  1.02 SELECT qiaoyixinli
#    5 0x476A95D312083789   9.1447  1.0%    19  0.4813  4.00 SELECT while_rep
#    6 0x4D41CF9302FA6F8F  33.7322  3.6%    25  1.3493  1.47 SELECT ims_core_cache
#    7 0xF3CDA5C1770E388F  14.0764  1.5%     9  1.5640  2.11 SELECT ims_mc_mapping_fans
#    8 0x796253C663E1C8CE   5.6543  0.6%     1  5.6543  0.00 SELECT while_rep while_cat
#    9 0x695E5E60651991F2  16.4097  1.7%     6  2.7349  0.40 SELECT dede_co_htmls
#   10 0xCE66DCE3597EFF42   4.6442  0.5%     1  4.6442  0.00 SELECT TABLES
#   11 0x79E1C8DA3A31C630  11.9477  1.3%    12  0.9956  2.05 SELECT ims_wechat_news
#   12 0x91F201E17CB08067   4.1233  0.4%     1  4.1233  0.00 SELECT TABLES
#   13 0x03AFE777450FD835   3.6930  0.4%     1  3.6930  0.00 SELECT qiaoyixinli
#   14 0xE958917A8E776CB7  12.5662  1.3%     6  2.0944  0.04 SELECT dede_addonarticle
#   15 0x03501D3472746CE1   2.5550  0.3%     1  2.5550  0.00 SELECT infosbdbusi
#   16 0x96D78854DE54F647   2.5139  0.3%     1  2.5139  0.00 SELECT infosbdbusi
#   17 0x99AA0165670CE848  69.0287  7.3%   562  0.1228  1.09 ADMIN PREPARE
#   18 0xCA101F2D917D89C7   2.3335  0.2%     1  2.3335  0.00 SELECT messagebd
#   19 0x0AA89354E33465CD   2.1800  0.2%     1  2.1800  0.00 SELECT messagebd
#   20 0xA924DB5906D69564   5.2276  0.6%     4  1.3069  0.33 SELECT area
#   25 0xCF7D6B8416942E54  21.1308  2.2%   178  0.1187  1.06 SELECT cmf_portal_post cmf_portal_category_post
# MISC 0xMISC             607.5455 64.5% 21900  0.0277   0.0 <789 ITEMS>

 

 

 

# Query 1: 0 QPS, 0x concurrency, ID 0x4D8A09430936693B at byte 1164501 __
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: all events occurred at 2019-07-10 20:07:11
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       1
# Exec time      1     14s     14s     14s     14s     14s       0     14s
# Lock time      0   114us   114us   114us   114us   114us       0   114us
# Rows sent      0    1000    1000    1000    1000    1000       0    1000
# Rows examine   0  18.79k  18.79k  18.79k  18.79k  18.79k       0  18.79k
# Query size     0      58      58      58      58      58       0      58
# String:
# Databases    shangqiao
# Hosts        124.64.17.104
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms
#    1s
#  10s+  ################################################################
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'shangqiao'\G
#    SHOW CREATE TABLE `shangqiao`.`shangqiao`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `shangqiao` ORDER BY `id` DESC LIMIT 0, 1000\G

 

 

 

# Query 2: 0.00 QPS, 0.00x concurrency, ID 0xBFBEAB2DCE0C7048 at byte 1173664
# This item is included in the report because it matches --limit.
# Scores: V/M = 2.06
# Time range: 2019-07-11 01:50:13 to 2019-07-25 07:48:51
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      21
# Exec time      4     46s   212ms     10s      2s      4s      2s      2s
# Lock time      0     2ms    66us    95us    76us    84us     8us    69us
# Rows sent      1  10.64k     125    1000  519.05  964.41  328.11  363.48
# Rows examine   0  57.63k     250  27.75k   2.74k   8.06k   5.92k  719.66
# Query size     0   1.23k      60      60      60      60       0      60
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (16/76%), 114.242.250.169 (2/9%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms  ##########################################
#    1s  ################################################################
#  10s+  #####
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` ORDER BY `id` DESC LIMIT 0, 1000\G

 

 

 

# Query 3: 0 QPS, 0x concurrency, ID 0xCEF2FE22D940E046 at byte 5756079 __
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: all events occurred at 2020-02-07 20:23:39
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       1
# Exec time      1      9s      9s      9s      9s      9s       0      9s
# Lock time      0   102us   102us   102us   102us   102us       0   102us
# Rows sent      0    1000    1000    1000    1000    1000       0    1000
# Rows examine   0    1000    1000    1000    1000    1000       0    1000
# Query size     0      36      36      36      36      36       0      36
# String:
# Databases    information_schema
# Hosts        183.197.37.189
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `information_schema` LIKE 'TABLES'\G
#    SHOW CREATE TABLE `information_schema`.`TABLES`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `TABLES` LIMIT 0, 1000\G

 

 

 

# Query 4: 0.00 QPS, 0.00x concurrency, ID 0x79F0E996230BE344 at byte 1173204
# This item is included in the report because it matches --limit.
# Scores: V/M = 1.02
# Time range: 2019-07-11 01:45:01 to 2019-07-25 07:48:32
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      12
# Exec time      4     43s    91ms      8s      4s      4s      2s      4s
# Lock time      0   916us    63us   103us    76us    93us    13us    73us
# Rows sent      1   9.96k     125    1000  849.50  964.41  311.65  964.41
# Rows examine   0   9.96k     125    1000  849.50  964.41  311.65  964.41
# Query size     0     492      41      41      41      41       0      41
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (6/50%), 114.242.250.169 (3/25%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ######
# 100ms  ######
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` LIMIT 0, 1000\G
.............后面的输出太长,省略............

案例6:分析指含有select语句的慢查询

[root@iZ25ja2kaemZ ~]# pt-query-digest --filter '$event->{fingerprint} =~ m/^select/i' --limit 10 /var/run/mysqld/mysqld-slow.log

 

# 4.7s user time, 50ms system time, 33.04M rss, 213.84M vsz
# Current date: Tue Mar  3 19:16:41 2020
# Hostname: iZ25ja2kaemZ
# Files: /var/run/mysqld/mysqld-slow.log
# Overall: 13.67k total, 510 unique, 0.00 QPS, 0.00x concurrency _________
# Time range: 2019-05-14 02:56:36 to 2020-03-03 18:42:04
# Attribute          total     min     max     avg     95%  stddev  median
# ============     ======= ======= ======= ======= ======= ======= =======
# Exec time           624s    43us     14s    46ms    75ms   289ms    17ms
# Lock time            31s       0   850ms     2ms     5ms    16ms    93us
# Rows sent        444.36k       0   4.51k   33.28   23.65  280.58    0.99
# Rows examine       8.00M       0 345.12k  613.27  463.90   5.59k    0.99
# Query size         2.09M      20     958  160.48  346.17   95.88  118.34

 

# Profile
# Rank Query ID           Response time  Calls R/Call  V/M   Item
# ==== ================== ============== ===== ======= ===== =============
#    1 0xF382DCE6D809E44D  96.7103 15.5%  4634  0.0209  0.04 SELECT information_schema.triggers
#    2 0xBFBEAB2DCE0C7048  46.1048  7.4%    21  2.1955  2.06 SELECT qiaoyixinli
#    3 0x79F0E996230BE344  43.0752  6.9%    12  3.5896  1.02 SELECT qiaoyixinli
#    4 0x4D41CF9302FA6F8F  33.7322  5.4%    25  1.3493  1.47 SELECT ims_core_cache
#    5 0xA846C3DAB1512DA6  22.1964  3.6%   531  0.0418  0.03 SELECT ims_core_cache
#    6 0xCF7D6B8416942E54  21.1308  3.4%   178  0.1187  1.06 SELECT cmf_portal_post cmf_portal_category_post
#    7 0x695E5E60651991F2  16.4097  2.6%     6  2.7349  0.40 SELECT dede_co_htmls
#    8 0x4D8A09430936693B  14.3093  2.3%     1 14.3093  0.00 SELECT shangqiao
#    9 0xF3CDA5C1770E388F  14.0764  2.3%     9  1.5640  2.11 SELECT ims_mc_mapping_fans
#   10 0xE958917A8E776CB7  12.5662  2.0%     6  2.0944  0.04 SELECT dede_addonarticle
#   11 0x79E1C8DA3A31C630  11.9477  1.9%    12  0.9956  2.05 SELECT ims_wechat_news
# MISC 0xMISC             291.6528 46.7%  8237  0.0354   0.0 <499 ITEMS>

 

# Query 1: 0.00 QPS, 0.00x concurrency, ID 0xF382DCE6D809E44D at byte 388392
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.04
# Time range: 2019-05-14 12:04:53 to 2020-02-05 07:43:53
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count         33    4634
# Exec time     15     97s    11ms   865ms    21ms    36ms    27ms    17ms
# Lock time      5      2s   130us    66ms   370us   424us     1ms   301us
# Rows sent      0       0       0       0       0       0       0       0
# Rows examine   0       0       0       0       0       0       0       0
# Query size    48   1.02M     209     253  230.67  234.30    7.84  223.14
# String:
# Databases    zhaopin (1077/23%), wyq (697/15%)... 9 more
# Hosts        114.249.118.195 (1151/24%)... 30 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  #
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `information_schema` LIKE 'triggers'\G
#    SHOW CREATE TABLE `information_schema`.`triggers`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT trigger_name, event_manipulation, event_object_table, action_statement, action_timing, DEFINER FROM information_schema.triggers WHERE BINARY event_object_schema='wyq' AND BINARY event_object_table='caiwu_cat'\G

 

# Query 2: 0.00 QPS, 0.00x concurrency, ID 0xBFBEAB2DCE0C7048 at byte 1181361
# This item is included in the report because it matches --limit.
# Scores: V/M = 2.06
# Time range: 2019-07-11 01:50:13 to 2019-07-25 07:48:51
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      21
# Exec time      7     46s   212ms     10s      2s      4s      2s      2s
# Lock time      0     2ms    66us    95us    76us    84us     8us    69us
# Rows sent      2  10.64k     125    1000  519.05  964.41  328.11  363.48
# Rows examine   0  57.63k     250  27.75k   2.74k   8.06k   5.92k  719.66
# Query size     0   1.23k      60      60      60      60       0      60
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (16/76%), 114.242.250.169 (2/9%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms  ##########################################
#    1s  ################################################################
#  10s+  #####
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` ORDER BY `id` DESC LIMIT 0, 1000\G

 

# Query 3: 0.00 QPS, 0.00x concurrency, ID 0x79F0E996230BE344 at byte 1181116
# This item is included in the report because it matches --limit.
# Scores: V/M = 1.02
# Time range: 2019-07-11 01:45:01 to 2019-07-25 07:48:32
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      12
# Exec time      6     43s    91ms      8s      4s      4s      2s      4s
# Lock time      0   916us    63us   103us    76us    93us    13us    73us
# Rows sent      2   9.96k     125    1000  849.50  964.41  311.65  964.41
# Rows examine   0   9.96k     125    1000  849.50  964.41  311.65  964.41
# Query size     0     492      41      41      41      41       0      41
# String:
# Databases    shangqiao
# Hosts        117.136.38.164 (6/50%), 114.242.250.169 (3/25%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ######
# 100ms  ######
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'qiaoyixinli'\G
#    SHOW CREATE TABLE `shangqiao`.`qiaoyixinli`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `qiaoyixinli` LIMIT 0, 1000\G

 

# Query 4: 0.00 QPS, 0.00x concurrency, ID 0x4D41CF9302FA6F8F at byte 676598
# This item is included in the report because it matches --limit.
# Scores: V/M = 1.47
# Time range: 2019-05-16 18:07:27 to 2019-12-24 14:03:36
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      25
# Exec time      5     34s    80ms      6s      1s      3s      1s   609ms
# Lock time      0     4ms    58us   357us   170us   224us    61us   176us
# Rows sent      0   1.86k      35     157   76.12  143.84   38.45   54.21
# Rows examine   0   1.86k      35     157   76.12  143.84   38.45   54.21
# Query size     0     750      30      30      30      30       0      30
# String:
# Databases    weiyinqing... (5/20%), zhaopin (5/20%)... 5 more
# Hosts        114.249.118.195 (7/28%)... 7 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ####
# 100ms  ################################################################
#    1s  #############################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weixindrkdpk` LIKE 'ims_core_cache'\G
#    SHOW CREATE TABLE `weixindrkdpk`.`ims_core_cache`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `ims_core_cache`\G

 

# Query 5: 0.00 QPS, 0.00x concurrency, ID 0xA846C3DAB1512DA6 at byte 5655839
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.03
# Time range: 2019-05-15 23:33:11 to 2020-03-01 05:44:20
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          3     531
# Exec time      3     22s    10ms   402ms    42ms   105ms    37ms    28ms
# Lock time     17      6s    20us   215ms    10ms    59ms    25ms    54us
# Rows sent      0     531       1       1       1       1       0       1
# Rows examine   0     531       1       1       1       1       0       1
# Query size     1  39.38k      73      90   75.95   76.28    2.62   72.65
# String:
# Databases    zhaopin (307/57%), weiyinqing... (111/20%)... 5 more
# Hosts        localhost
# Users        zhaopin (307/57%), admin (129/24%)... 3 more
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  #####
#    1s
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `zhaopin` LIKE 'ims_core_cache'\G
#    SHOW CREATE TABLE `zhaopin`.`ims_core_cache`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT `value` FROM `ims_core_cache` WHERE `key` = 'we7:system_frame:0'  LIMIT 1\G

 

# Query 6: 0.00 QPS, 0.00x concurrency, ID 0xCF7D6B8416942E54 at byte 5495272
# This item is included in the report because it matches --limit.
# Scores: V/M = 1.06
# Time range: 2019-05-14 02:56:36 to 2020-03-03 18:17:19
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          1     178
# Exec time      3     21s   152us      2s   119ms      1s   355ms    21ms
# Lock time      9      3s    10us   308ms    17ms   189ms    65ms    11us
# Rows sent      0     178       1       1       1       1       0       1
# Rows examine   0  25.63k      15     207  147.44  202.40   64.31  151.03
# Query size     1  33.90k     195     195     195     195       0     195
# String:
# Databases    thinkcmfww... (104/58%), servercmf (41/23%)... 1 more
# Hosts        localhost
# Users        root
# Query_time distribution
#   1us
#  10us
# 100us  #################################
#   1ms  #
#  10ms  ################################################################
# 100ms
#    1s  #######
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `thinkcmfwww` LIKE 'cmf_portal_post'\G
#    SHOW CREATE TABLE `thinkcmfwww`.`cmf_portal_post`\G
#    SHOW TABLE STATUS FROM `thinkcmfwww` LIKE 'cmf_portal_category_post'\G
#    SHOW CREATE TABLE `thinkcmfwww`.`cmf_portal_category_post`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT COUNT(*) AS tp_count FROM `cmf_portal_post` `pp` LEFT JOIN `cmf_portal_category_post` `pcp` ON `pp`.`id`=`pcp`.`post_id` WHERE  `pp`.`post_type` = '1'  AND `pp`.`post_status` = '1' LIMIT 1\G

 

# Query 7: 0.00 QPS, 0.00x concurrency, ID 0x695E5E60651991F2 at byte 3073770
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.40
# Time range: 2019-05-14 12:05:30 to 2020-02-05 07:44:02
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       6
# Exec time      2     16s      2s      5s      3s      5s      1s      3s
# Lock time      0     1ms   148us   299us   209us   287us    51us   231us
# Rows sent      0     438      73      73      73      73       0      73
# Rows examine   0     438      73      73      73      73       0      73
# Query size     0     174      29      29      29      29       0      29
# String:
# Databases    wyq
# Hosts        114.242.248.191 (1/16%)... 5 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `wyq` LIKE 'dede_co_htmls'\G
#    SHOW CREATE TABLE `wyq`.`dede_co_htmls`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `dede_co_htmls`\G

 

# Query 8: 0 QPS, 0x concurrency, ID 0x4D8A09430936693B at byte 1164501 __
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.00
# Time range: all events occurred at 2019-07-10 20:07:11
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       1
# Exec time      2     14s     14s     14s     14s     14s       0     14s
# Lock time      0   114us   114us   114us   114us   114us       0   114us
# Rows sent      0    1000    1000    1000    1000    1000       0    1000
# Rows examine   0  18.79k  18.79k  18.79k  18.79k  18.79k       0  18.79k
# Query size     0      58      58      58      58      58       0      58
# String:
# Databases    shangqiao
# Hosts        124.64.17.104
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms
#    1s
#  10s+  ################################################################
# Tables
#    SHOW TABLE STATUS FROM `shangqiao` LIKE 'shangqiao'\G
#    SHOW CREATE TABLE `shangqiao`.`shangqiao`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `shangqiao` ORDER BY `id` DESC LIMIT 0, 1000\G

 

# Query 9: 0.00 QPS, 0.00x concurrency, ID 0xF3CDA5C1770E388F at byte 4415531
# This item is included in the report because it matches --limit.
# Scores: V/M = 2.11
# Time range: 2019-05-21 17:57:22 to 2019-12-24 14:03:40
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       9
# Exec time      2     14s    31ms      6s      2s      5s      2s   293ms
# Lock time      0     1ms    55us   213us   123us   204us    39us   125us
# Rows sent      0   1.37k       2     289  155.78  284.79  118.59  166.51
# Rows examine   0   1.37k       2     289  155.78  284.79  118.59  166.51
# Query size     0     315      35      35      35      35       0      35
# String:
# Databases    weiyinqing... (3/33%), weixinxort... (2/22%)... 3 more
# Hosts        114.249.114.179 (3/33%)... 3 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ################################################################
# 100ms  ################
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weixinxortrta` LIKE 'ims_mc_mapping_fans'\G
#    SHOW CREATE TABLE `weixinxortrta`.`ims_mc_mapping_fans`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `ims_mc_mapping_fans`\G

 

# Query 10: 0.00 QPS, 0.00x concurrency, ID 0xE958917A8E776CB7 at byte 3073139
# This item is included in the report because it matches --limit.
# Scores: V/M = 0.04
# Time range: 2019-05-14 12:05:25 to 2020-02-05 07:43:57
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0       6
# Exec time      2     13s      2s      3s      2s      3s   272ms      2s
# Lock time      0     1ms   146us   243us   179us   236us    32us   159us
# Rows sent      0     522      87      87      87      87       0      87
# Rows examine   0     522      87      87      87      87       0      87
# Query size     0     198      33      33      33      33       0      33
# String:
# Databases    wyq
# Hosts        114.242.248.191 (1/16%)... 5 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms
# 100ms
#    1s  ################################################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `wyq` LIKE 'dede_addonarticle'\G
#    SHOW CREATE TABLE `wyq`.`dede_addonarticle`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `dede_addonarticle`\G

 

# Query 11: 0.00 QPS, 0.00x concurrency, ID 0x79E1C8DA3A31C630 at byte 3437201
# This item is included in the report because it matches --outliers.
# Scores: V/M = 2.05
# Time range: 2019-05-16 18:07:31 to 2019-12-24 14:03:50
# Attribute    pct   total     min     max     avg     95%  stddev  median
# ============ === ======= ======= ======= ======= ======= ======= =======
# Count          0      12
# Exec time      1     12s    54ms      4s   996ms      4s      1s   219ms
# Lock time      0     2ms    59us   281us   190us   260us    61us   204us
# Rows sent      0     137       2      23   11.42   22.53    6.87    8.91
# Rows examine   0     137       2      23   11.42   22.53    6.87    8.91
# Query size     0     372      31      31      31      31       0      31
# String:
# Databases    weiyinqing... (5/41%), weiyinqing (4/33%)... 2 more
# Hosts        124.64.18.177 (6/50%), 114.249.114.179 (3/25%)... 2 more
# Users        15933568633
# Query_time distribution
#   1us
#  10us
# 100us
#   1ms
#  10ms  ###################################################
# 100ms  ################################################################
#    1s  ######################################
#  10s+
# Tables
#    SHOW TABLE STATUS FROM `weiyinqingnew` LIKE 'ims_wechat_news'\G
#    SHOW CREATE TABLE `weiyinqingnew`.`ims_wechat_news`\G
# EXPLAIN /*!50100 PARTITIONS*/
SELECT * FROM `ims_wechat_news`\G

 欢迎加我们微信wang1415035017进入微信高级技术群共同进步,或者扫码加入我们哦(V_V) 

pt-query-digest分析mysql(mariadb)数据库慢查询日志(slow_query_log)详述_第1张图片

你可能感兴趣的:(mysql,linux)