https://github.com/csioza/tcpmotor
Overview:
TcpMotor is a minimal tcp transmit lib, whitch has lock-free, multi-thread, only-header, using c++11 and high performance features.
Design:(improving)
OneQueue
a single-producer, single-consumer lock-free queue.
MatrixQueue
a multi-producer, multi-consumer lock-free queue. using OneQueue.
TcpMotor
using MatrixQueue.
Usage:
- copy tcpmotor.h and matrixqueue.h into your project.
- include the header.
#include "tcpmotor.h"
- code.
dcore::TcpMotor *server = new dcore::TcpMotor(port, 5);
//receive handle, 接收消息会回调该接口
dcore::TcpRecvHandler *handler = new TestTcpRecvHandler();
server->SetRecvHandler(handler);
//启动
server->Run();
//发送数据
std::string data = "hello";
server->Send(ip, port, data.c_str(), data.size(), NULL);
//停止,清理内存
server->Stop();
delete server;
Notice:
- in matrixqueue.h
#define MATRIX_QUEUE_NUM_MAX_INDEX 1024 //一个进程创建MatrixQueue最大数量，注意要设置足够大，避免越界
#define MATRIX_QUEUE_ARRAY_MAX_NUM 1024 //MatrixQueue中生产者消费者矩阵大小，注意要设置足够大，避免越界
Test
生产环境 centos7 24cpu
跨机房 cpu:3% using matrixqueue_fixed_size.h
msg_len [1024]
qps [96175]
us0_499 [667254]
us500_999 [8824]
ms1_9 [1438]
ms10_19 [0]
ms20_29 [0]
ms30_39 [0]
ms40_49 [0]
ms50_59 [0]
ms60_69 [0]
ms70_79 [0]
ms80_89 [0]
ms90_99 [0]
average [87]
sumCount [680000]
本地机器 docker centos7 6cpu
using matrixqueue.h
msg_len [1024]
qps [15585]
us0_499 [994711]
us500_999 [504]
ms1_9 [75]
ms10_19 [0]
ms20_29 [0]
ms30_39 [0]
ms40_49 [0]
ms50_59 [0]
ms60_69 [0]
ms70_79 [0]
ms80_89 [0]
ms90_99 [0]
average [183]
sumCount [1000000]
using concurrentqueue.h
msg_len [1024]
qps [17856]
us0_499 [979580]
us500_999 [671]
ms1_9 [1218]
ms10_19 [309]
ms20_29 [252]
ms30_39 [39]
ms40_49 [0]
ms50_59 [0]
ms60_69 [0]
ms70_79 [0]
ms80_89 [0]
ms90_99 [0]
average [178]
sumCount [1000000]
内存检测
==00:00:00:17.467 666== HEAP SUMMARY:
==00:00:00:17.467 666== in use at exit: 0 bytes in 0 blocks
==00:00:00:17.467 666== total heap usage: 506,685 allocs, 506,685 frees, 345,307,952 bytes allocated
==00:00:00:17.467 666==
==00:00:00:17.468 666== All heap blocks were freed -- no leaks are possible
TODO List:
1.限流
2.DelLink 删除失败情况
3.增强健壮性
4.压测
5.queue验证正确性
6.增加单测
7.继续提高MatrixQueue性能