sysbench是一款开源的多线程性能测试工具,可以执行CPU/内存/线程/IO/数据库等方面的性能测试。
项目主页: http://sysbench.sourceforge.net/
安装文档http://sysbench.sourceforge.net/docs/#install
但是好像这两天打不开,在这儿提供一个0.4.12版的下载:sysbench-0.4.12.tar.gz
一.安装三步骤:
1.configure
./configure --prefix=/u01/sysbench/ --with-mysql-includes=/usr/include/mysql/ --with-mysql-libs=/usr/lib/mysql/ --with-mysql
其中标红的地方为mysql的2个路径,我在这个地方偷懒用的直接是yum install的方式安装的,所以路径为默认的这个。如果是自定义的,比如/u01/mysql之类的,那么路径就改成相应的就可以了。
2.make
这一步会根据上一步生成的makefile来进行make,但之前的configure里面,生成makefile的时候,是用的32位的包,所以需要ln一下,使用64位的包:
ln -s /usr/lib64/mysql/* /usr/lib/mysql/,再执行autogen.sh,再执行make
3.make install
二.使用
首先,看看sysbench支持哪些功能参数:
[root@monsrv bin]# sysbench --hlp Unknown option: --hlp. Usage: sysbench [general-options]... --test=<test-name> [test-options]... command General options: --num-threads=N number of threads to use [1] --max-requests=N limit for total number of requests [10000] --max-time=N limit for total execution time in seconds [0] --forced-shutdown=STRING amount of time to wait after --max-time before forcing shutdown [off] --thread-stack-size=SIZE size of stack per thread [32K] --init-rng=[on|off] initialize random number generator [off] --test=STRING test to run --debug=[on|off] print more debugging info [off] --validate=[on|off] perform validation checks where possible [off] --help=[on|off] print help and exit --version=[on|off] print version and exit Compiled-in tests: fileio - File I/O test cpu - CPU performance test memory - Memory functions speed test threads - Threads subsystem performance test mutex - Mutex performance test oltp - OLTP test Commands: prepare run cleanup help version See 'sysbench --test=<name> help' for a list of options for each test.
从帮助可以看出,sysbench的测试主要包括以下几个方面:
(1)磁盘io性能
(2)cpu性能
(3)内存分配及传输速度
(4)线程性能
(5)mutex性能
(6)OLTP基准测试
2.1 测试fileio命令帮助:
[root@monsrv bin]# sysbench --test=fileio help sysbench 0.4.12: multi-threaded system evaluation benchmark fileio options: --file-num=N number of files to create [128] --file-block-size=N block size to use in all IO operations [16384] --file-total-size=SIZE total size of files to create [2G] --file-test-mode=STRING test mode {seqwr, seqrewr, seqrd, rndrd, rndwr, rndrw} --file-io-mode=STRING file operations mode {sync,async,fastmmap,slowmmap} [sync] --file-async-backlog=N number of asynchronous operatons to queue per thread [128] --file-extra-flags=STRING additional flags to use on opening files {sync,dsync,direct} [] --file-fsync-freq=N do fsync() after this number of requests (0 - don't use fsync()) [100] --file-fsync-all=[on|off] do fsync() after each write operation [off] --file-fsync-end=[on|off] do fsync() at the end of test [on] --file-fsync-mode=STRING which method to use for synchronization {fsync, fdatasync} [fsync] --file-merged-requests=N merge at most this number of IO requests if possible (0 - don't merge) [0] --file-rw-ratio=N reads/writes ratio for combined test [1.5]
参数详解:
--file-num=N 代表生成测试文件的数量,默认为128。
--file-block-size=N 测试时所使用文件块的大小,如果想磁盘针对innodb存储引擎进行测试,可以将其设置为16384,即innodb存储引擎页的大小。默认为16384。
--file-total-size=SIZE 创建测试文件的总大小,默认为2G大小。
--file-test-mode=STRING 文件测试模式,包含:seqwr(顺序写), seqrewr(顺序读写), seqrd(顺序读), rndrd(随机读), rndwr(随机写), rndrw(随机读写)。
--file-io-mode=STRING 文件操作的模式,sync(同步),async(异步),fastmmap(快速mmap),slowmmap(慢速mmap),默认为sync同步模式。
--file-async-backlog=N 对应每个线程队列的异步操作数,默认为128。
--file-extra-flags=STRING 打开文件时的选项,这是与API相关的参数。
--file-fsync-freq=N 执行fsync()函数的频率。fsync主要是同步磁盘文件,因为可能有系统和磁盘缓冲的关系。 0代表不使用fsync函数。默认值为100。
--file-fsync-all=[on|off] 每执行完一次写操作,就执行一次fsync。默认为off。
--file-fsync-end=[on|off] 在测试结束时执行fsync函数。默认为on。
--file-fsync-mode=STRING文件同步函数的选择,同样是和API相关的参数,由于多个操作系统对于fdatasync支持不同,因此不建议使用fdatasync。默认为fsync。
--file-merged-requests=N 大多情况下,合并可能的IO的请求数,默认为0。
--file-rw-ratio=N 测试时的读写比例,默认时为1.5,即可3:2。
示例:
生成16个总共2G的文件,进行读写io测试
准备工作:
[root@monsrv bin]# sysbench --test=fileio --file-num=16 --file-total-size=2G prepare sysbench 0.4.12: multi-threaded system evaluation benchmark 16 files, 131072Kb each, 2048Mb total Creating files for the test...
[root@monsrv bin]# ls -lrth
total 2.1G
-rwxr-xr-x 1 root root 293K Oct 15 16:20 sysbench
-rw------- 1 root root 128M Oct 15 17:38 test_file.0
-rw------- 1 root root 128M Oct 15 17:38 test_file.1
-rw------- 1 root root 128M Oct 15 17:38 test_file.2
-rw------- 1 root root 128M Oct 15 17:39 test_file.3
-rw------- 1 root root 128M Oct 15 17:39 test_file.4
-rw------- 1 root root 128M Oct 15 17:39 test_file.5
-rw------- 1 root root 128M Oct 15 17:39 test_file.6
-rw------- 1 root root 128M Oct 15 17:39 test_file.7
-rw------- 1 root root 128M Oct 15 17:39 test_file.8
-rw------- 1 root root 128M Oct 15 17:39 test_file.9
-rw------- 1 root root 128M Oct 15 17:39 test_file.10
-rw------- 1 root root 128M Oct 15 17:40 test_file.11
-rw------- 1 root root 128M Oct 15 17:40 test_file.12
-rw------- 1 root root 128M Oct 15 17:40 test_file.13
-rw------- 1 root root 128M Oct 15 17:40 test_file.14
-rw------- 1 root root 128M Oct 15 17:40 test_file.15
开始测试:
[root@monsrv bin]# sysbench --test=fileio --file-total-size=2G --file-test-mode=rndrd --max-time=180 --max-requests=100000000 --num-threads=16 --init-rng=on --file-num=16 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=16384 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 16 Initializing random number generator from timer. Extra file open flags: 16384 16 files, 128Mb each 2Gb total file size Block size 16Kb Number of random requests for random IO: 100000000 Read/Write ratio for combined random IO test: 1.50 Calling fsync() at the end of test, Enabled. Using synchronous I/O mode Doing random read test Threads started! Time limit exceeded, exiting... (last message repeated 15 times) Done. Operations performed: 314382 Read, 0 Write, 0 Other = 314382 Total Read 4.7971Gb Written 0b Total transferred 4.7971Gb (27.288Mb/sec) 1746.43 Requests/sec executed Test execution summary: total time: 180.0138s total number of events: 314382 total time taken by event execution: 2879.5979 per-request statistics: min: 0.26ms avg: 9.16ms max: 131.24ms approx. 95 percentile: 25.96ms Threads fairness: events (avg/stddev): 19648.8750/138.91 execution time (avg/stddev): 179.9749/0.00 [root@monsrv bin]# sysbench --test=fileio --file-total-size=2G --file-test-mode=rndrd --max-time=180 --max-requests=100000000 --num-threads=16 --init-rng=on --file-num=16 --file-extra-flags=direct --file-fsync-freq=0 --file-block-size=16384 run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 16 Initializing random number generator from timer. Extra file open flags: 16384 16 files, 128Mb each 2Gb total file size Block size 16Kb Number of random requests for random IO: 100000000 Read/Write ratio for combined random IO test: 1.50 Calling fsync() at the end of test, Enabled. Using synchronous I/O mode Doing random read test Threads started! Time limit exceeded, exiting... (last message repeated 15 times) Done. Operations performed: 313704 Read, 0 Write, 0 Other = 313704 Total Read 4.7867Gb Written 0b Total transferred 4.7867Gb (27.229Mb/sec) 1742.62 Requests/sec executed Test execution summary: total time: 180.0182s total number of events: 313704 total time taken by event execution: 2879.6401 per-request statistics: min: 0.25ms avg: 9.18ms max: 121.35ms approx. 95 percentile: 26.06ms Threads fairness: events (avg/stddev): 19606.5000/85.96 execution time (avg/stddev): 179.9775/0.00
测试结果主要看标黄色的那一段。为了稳定,测了2次,看起来差不多。
测试完成后,需要把测试文件给删掉。
[root@monsrv bin]# sysbench --test=fileio --file-num=16 --file-total-size=2G cleanup sysbench 0.4.12: multi-threaded system evaluation benchmark Removing test files... [root@monsrv bin]# ls -lrth total 300K -rwxr-xr-x 1 root root 293K Oct 15 16:20 sysbench
2.2 测试cpu命令帮助:
[root@monsrv bin]# sysbench --test=cpu help sysbench 0.4.12: multi-threaded system evaluation benchmark cpu options: --cpu-max-prime=N upper limit for primes generator [10000]
参数详解:
--cpu-max-prime=N 用来选项指定最大的素数,具体参数可以根据CPU的性能来设置,默认为10000
2.3 测试memory命令帮助:
[root@monsrv bin]# sysbench --test=memory help sysbench 0.4.12: multi-threaded system evaluation benchmark memory options: --memory-block-size=SIZE size of memory block for test [1K] --memory-total-size=SIZE total size of data to transfer [100G] --memory-scope=STRING memory access scope {global,local} [global] --memory-hugetlb=[on|off] allocate memory from HugeTLB pool [off] --memory-oper=STRING type of memory operations {read, write, none} [write] --memory-access-mode=STRING memory access mode {seq,rnd} [seq]
参数详解:
--memory-block-size=SIZE 测试内存块的大小,默认为1K
--memory-total-size=SIZE 数据传输的总大小,默认为100G
--memory-scope=STRING 内存访问的范围,包括全局和本地范围,默认为global
--memory-hugetlb=[on|off] 是否从HugeTLB池分配内存的开关,默认为off
--memory-oper=STRING 内存操作的类型,包括read, write, none,默认为write
--memory-access-mode=STRING 内存访问模式,包括seq,rnd两种模式,默认为seq
2.4 测试threads命令帮助:
[root@monsrv bin]# sysbench --test=threads help sysbench 0.4.12: multi-threaded system evaluation benchmark threads options: --thread-yields=N number of yields to do per request [1000] --thread-locks=N number of locks per thread [8]
参数详解:
--thread-yields=N 指定每个请求的压力,默认为1000
--thread-locks=N 指定每个线程的锁数量,默认为8
2.5 测试mutex命令帮助:
[root@monsrv bin]# sysbench --test=mutex help sysbench 0.4.12: multi-threaded system evaluation benchmark mutex options: --mutex-num=N total size of mutex array [4096] --mutex-locks=N number of mutex locks to do per thread [50000] --mutex-loops=N number of empty loops to do inside mutex lock [10000]
参数详解:
--mutex-num=N 数组互斥的总大小。默认是4096
--mutex-locks=N 每个线程互斥锁的数量。默认是50000
--mutex-loops=N 内部互斥锁的空循环数量。默认是10000
2.6 测试oltp命令帮助:
[root@monsrv bin]# sysbench --test=oltp help sysbench 0.4.12: multi-threaded system evaluation benchmark oltp options: --oltp-test-mode=STRING test type to use {simple,complex,nontrx,sp} [complex] --oltp-reconnect-mode=STRING reconnect mode {session,transaction,query,random} [session] --oltp-sp-name=STRING name of store procedure to call in SP test mode [] --oltp-read-only=[on|off] generate only 'read' queries (do not modify database) [off] --oltp-skip-trx=[on|off] skip BEGIN/COMMIT statements [off] --oltp-range-size=N range size for range queries [100] --oltp-point-selects=N number of point selects [10] --oltp-simple-ranges=N number of simple ranges [1] --oltp-sum-ranges=N number of sum ranges [1] --oltp-order-ranges=N number of ordered ranges [1] --oltp-distinct-ranges=N number of distinct ranges [1] --oltp-index-updates=N number of index update [1] --oltp-non-index-updates=N number of non-index updates [1] --oltp-nontrx-mode=STRING mode for non-transactional test {select, update_key, update_nokey, insert, delete} [select] --oltp-auto-inc=[on|off] whether AUTO_INCREMENT (or equivalent) should be used on id column [on] --oltp-connect-delay=N time in microseconds to sleep after connection to database [10000] --oltp-user-delay-min=N minimum time in microseconds to sleep after each request [0] --oltp-user-delay-max=N maximum time in microseconds to sleep after each request [0] --oltp-table-name=STRING name of test table [sbtest] --oltp-table-size=N number of records in test table [10000] --oltp-dist-type=STRING random numbers distribution {uniform,gaussian,special} [special] --oltp-dist-iter=N number of iterations used for numbers generation [12] --oltp-dist-pct=N percentage of values to be treated as 'special' (for special distribution) [1] --oltp-dist-res=N percentage of 'special' values to use (for special distribution) [75] General database options: --db-driver=STRING specifies database driver to use ('help' to get list of available drivers) --db-ps-mode=STRING prepared statements usage mode {auto, disable} [auto] Compiled-in database drivers: mysql - MySQL driver mysql options: --mysql-host=[LIST,...] MySQL server host [localhost] --mysql-port=N MySQL server port [3306] --mysql-socket=STRING MySQL socket --mysql-user=STRING MySQL user [sbtest] --mysql-password=STRING MySQL password [] --mysql-db=STRING MySQL database name [sbtest] --mysql-table-engine=STRING storage engine to use for the test table {myisam,innodb,bdb,heap,ndbcluster,federated} [innodb] --mysql-engine-trx=STRING whether storage engine used is transactional or not {yes,no,auto} [auto] --mysql-ssl=[on|off] use SSL connections, if available in the client library [off] --myisam-max-rows=N max-rows parameter for MyISAM tables [1000000] --mysql-create-options=STRING additional options passed to CREATE TABLE []
参数详解:
--oltp-test-mode=STRING 执行模式{simple,complex(advanced transactional),nontrx(non-transactional),sp}。默认是complex
--oltp-reconnect-mode=STRING 重新连接模式{session(不使用重新连接。每个线程断开只在测试结束),transaction(在每次事务结束后重新连接),query(在每个SQL语句执行完重新连接),random(对于每个事务随机选择以上重新连接模式)}。默认是session
--oltp-sp-name=STRING 存储过程的名称。默认为空
--oltp-read-only=[on|off] 只读模式。Update,delete,insert语句不可执行。默认是off
--oltp-skip-trx=[on|off] 省略begin/commit语句。默认是off
--oltp-range-size=N 查询范围。默认是100
--oltp-point-selects=N number of point selects [10]
--oltp-simple-ranges=N number of simple ranges [1]
--oltp-sum-ranges=N number of sum ranges [1]
--oltp-order-ranges=N number of ordered ranges [1]
--oltp-distinct-ranges=N number of distinct ranges [1]
--oltp-index-updates=N number of index update [1]
--oltp-non-index-updates=N number of non-index updates [1]
--oltp-nontrx-mode=STRING 查询类型对于非事务执行模式{select, update_key, update_nokey, insert, delete} [select]
--oltp-auto-inc=[on|off] AUTO_INCREMENT是否开启。默认是on
--oltp-connect-delay=N 在多少微秒后连接数据库。默认是10000
--oltp-user-delay-min=N 每个请求最短等待时间。单位是ms。默认是0
--oltp-user-delay-max=N 每个请求最长等待时间。单位是ms。默认是0
--oltp-table-name=STRING 测试时使用到的表名。默认是sbtest
--oltp-table-size=N 测试表的记录数。默认是10000
--oltp-dist-type=STRING 分布的随机数{uniform(均匀分布),Gaussian(高斯分布),special(空间分布)}。默认是special
--oltp-dist-iter=N 产生数的迭代次数。默认是12
--oltp-dist-pct=N 值的百分比被视为'special' (for special distribution)。默认是1
--oltp-dist-res=N 'special'的百分比值。默认是75
示例:
首先准备sbest测试表,因为脚本默认不会建库,那么需要先在MySQL中吧库建好,当然也可以用参数--mysql-db指定数据库。
[root@monsrv ~]# sysbench --test=oltp --num-threads=1 --max-requests=80000 --oltp-test-mode=complex --db-driver=mysql --mysql-db=sbtest --mysql-host=192.168.0.155 --mysql-port=1234 --mysql-user=root --mysql-password=aostarit --oltp-nontrx-mode=select --db-ps-mode=disable prepare sysbench 0.4.12: multi-threaded system evaluation benchmark Creating table 'sbtest'... Creating 10000 records in table 'sbtest'...
接着就是测试了。我在这儿设置了80000个请求,也就是说这个测试需要做完80000个request才会停止,可以适当的调整。
[root@monsrv ~]# sysbench --test=oltp --num-threads=1 --max-requests=80000 --oltp-test-mode=complex --db-driver=mysql --mysql-db=sbtest --mysql-host=192.168.0.155 --mysql-port=1234 --mysql-user=root --mysql-password=aostarit --oltp-nontrx-mode=select --db-ps-mode=disable run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 1 Doing OLTP test. Running mixed OLTP test Using Special distribution (12 iterations, 1 pct of values are returned in 75 pct cases) Using "BEGIN" for starting transactions Using auto_inc on the id column Maximum number of requests for OLTP test is limited to 80000 Threads started! Done. OLTP test statistics: queries performed: read: 1120000 write: 400000 other: 160000 total: 1680000 transactions: 80000 (42.98 per sec.) deadlocks: 0 (0.00 per sec.) read/write requests: 1520000 (816.54 per sec.) other operations: 160000 (85.95 per sec.) Test execution summary: total time: 1861.5174s total number of events: 80000 total time taken by event execution: 1860.8692 per-request statistics: min: 18.08ms avg: 23.26ms max: 886.62ms approx. 95 percentile: 34.32ms Threads fairness: events (avg/stddev): 80000.0000/0.00 execution time (avg/stddev): 1860.8692/0.00 [root@monsrv ~]#
最后就是清除