zeromq_传说中最快的消息队列

Zeromq的资源:

Zeromq模式:

http://blog.codingnow.com/2011/02/zeromq_message_patterns.html

zeromq主页:

http://www.zeromq.org/

Zeromq Guild:

http://zguide.zeromq.org/page:all#Fixing-the-World

Zeromq 中文简介:

http://blog.csdn.net/program_think/article/details/6687076

Zero wiki:

http://en.wikipedia.org/wiki/%C3%98MQ

zeromq系列:

http://iyuan.iteye.com/blog/972949

Zeromq资源阅读:

ØMQ(Zeromq) 是一个更为高效的传输层

优势是:

1 程序接口库是一个并发框架

2 在集群和超级计算机上表现得比TCP更快

3 通过inproc, IPC, TCP, 和 multicast进行传播消息

4 通过发散,订阅,流水线,请求的方式连接

5 对于不定规模的多核消息传输应用使用异步IO

6 有非常大并且活跃的开源社区

7 支持30+的语言

8 支持多种系统

 

Zeromq定义为“史上最快的消息队列”

从网络通信的角度看,它处于会话层之上,应用层之下。

ØMQ (ZeroMQ, 0MQ, zmq) looks like an embeddable networking library but acts like a concurrency framework. It gives you sockets that carry whole messages across various transports like in-process, inter-process, TCP, and multicast. You can connect sockets N-to-N with patterns like fanout, pub-sub, task distribution, and request-reply. It's fast enough to be the fabric for clustered products. Its asynchronous I/O model gives you scalable multicore applications, built as asynchronous message-processing tasks. It has a score of language APIs and runs on most operating systems. ØMQ is from iMatix and is LGPL open source.


Zeromq中传递的数据格式是由用户自己负责,就是说如果server发送的string是有带"\0"的,那么client就必须要知道有这个

 

Pub_Sub模式。

the subscriber will always miss the first messages that the publisher sends. This is because as the subscriber connects to the publisher (something that takes a small but non-zero time), the publisher may already be sending messages out.

在这种模式下很可能发布者刚启动时发布的数据出现丢失,原因是用zmq发送速度太快,在订阅者尚未与发布者建立联系时,已经开始了数据发布(内部局域网没这么夸张的)。官网给了两个解决方案;1,发布者sleep一会再发送数据(这个被标注成愚蠢的);2,使用proxy。

Zeromq示例:

1 获取例子

git clone --depth=1 git://github.com/imatix/zguide.git

2 服务器端:

(当服务器收到消息的时候,服务器回复“World”)

<?php

	/*

	*  Hello World server

	*  Binds REP socket to tcp://*:5555

	*  Expects "Hello" from client, replies with "World"

	* @author Ian Barber <ian(dot)barber(at)gmail(dot)com>

	*/

	

	$context = new ZMQContext(1);

	

	//  Socket to talk to clients

	$responder = new ZMQSocket($context, ZMQ::SOCKET_REP);

	$responder->bind("tcp://*:5555");

	

	while(true) {

	    //  Wait for next request from client

	    $request = $responder->recv();

	    printf ("Received request: [%s]\n", $request);

	

	    //  Do some 'work'

	    sleep (1);

	

	    //  Send reply back to client

	    $responder->send("World");    



}

3 客户端:

(客户端发送消息)

<?php

	/*

	*  Hello World client

	*  Connects REQ socket to tcp://localhost:5555

	*  Sends "Hello" to server, expects "World" back

	* @author Ian Barber <ian(dot)barber(at)gmail(dot)com>

	*/

	

	$context = new ZMQContext();

	

	//  Socket to talk to server

	echo "Connecting to hello world server…\n";

	$requester = new ZMQSocket($context, ZMQ::SOCKET_REQ);

	$requester->connect("tcp://localhost:5555");

	

	for($request_nbr = 0; $request_nbr != 10; $request_nbr++) {

	    printf ("Sending request %d…\n", $request_nbr);

	    $requester->send("Hello");

	    

	    $reply = $requester->recv();

	    printf ("Received reply %d: [%s]\n", $request_nbr, $reply);



}
 

天气气候订阅系统:(pub-sub)

1 server端:

<?php

	/*

	*  Weather update server

	*  Binds PUB socket to tcp://*:5556

	*  Publishes random weather updates

	* @author Ian Barber <ian(dot)barber(at)gmail(dot)com>

	*/

	

	//  Prepare our context and publisher

	$context = new ZMQContext();

	$publisher = $context->getSocket(ZMQ::SOCKET_PUB);

	$publisher->bind("tcp://*:5556");

	$publisher->bind("ipc://weather.ipc");

	

	while (true) {

	    //  Get values that will fool the boss

	    $zipcode     = mt_rand(0, 100000);

	    $temperature = mt_rand(-80, 135);

	    $relhumidity = mt_rand(10, 60);

	

	    //  Send message to all subscribers

	    $update = sprintf ("%05d %d %d", $zipcode, $temperature, $relhumidity);

	    $publisher->send($update);

	}

2 client端:

<?php

	/*

	*  Weather update client

	*  Connects SUB socket to tcp://localhost:5556

	*  Collects weather updates and finds avg temp in zipcode

	* @author Ian Barber <ian(dot)barber(at)gmail(dot)com>

	*/

	

	$context = new ZMQContext();

	

	//  Socket to talk to server

	echo "Collecting updates from weather server…", PHP_EOL;

	$subscriber = new ZMQSocket($context, ZMQ::SOCKET_SUB);

	$subscriber->connect("tcp://localhost:5556");

	

	//  Subscribe to zipcode, default is NYC, 10001

	$filter = $_SERVER['argc'] > 1 ? $_SERVER['argv'][1] : "10001";

	$subscriber->setSockOpt(ZMQ::SOCKOPT_SUBSCRIBE, $filter);

	

	//  Process 100 updates

	$total_temp = 0;

	for ($update_nbr = 0; $update_nbr < 100; $update_nbr++) {

	    $string = $subscriber->recv();

	    sscanf ($string, "%d %d %d", $zipcode, $temperature, $relhumidity);

	    $total_temp += $temperature;

	}

	printf ("Average temperature for zipcode '%s' was %dF\n",

	    $filter, (int) ($total_temp / $update_nbr));
------------------------
pub-sub的proxy模式:
图示是:

clip_image001_thumb[2]

Proxy节点的代码:

<?php

	/*

	*  Weather proxy device

	* @author Ian Barber <ian(dot)barber(at)gmail(dot)com>

	*/

	

	$context = new ZMQContext();

	

	//  This is where the weather server sits

	$frontend = new ZMQSocket($context, ZMQ::SOCKET_SUB);

	$frontend->connect("tcp://192.168.55.210:5556");

	

	//  This is our public endpoint for subscribers

	$backend = new ZMQSocket($context, ZMQ::SOCKET_PUB);

	$backend->bind("tcp://10.1.1.0:8100");

	

	//  Subscribe on everything

	$frontend->setSockOpt(ZMQ::SOCKOPT_SUBSCRIBE, "");

	

	//  Shunt messages out to our own subscribers

	while(true) {

	    while(true) {

	        //  Process all parts of the message

	        $message = $frontend->recv();

	        $more = $frontend->getSockOpt(ZMQ::SOCKOPT_RCVMORE);

	        $backend->send($message, $more ? ZMQ::SOCKOPT_SNDMORE : 0);

	        if(!$more) {

	            break; // Last message part

	        }

	    }



}
其实就是proxy同时是作为pub又作为sub的

    ----------------------

作者:yjf512(轩脉刃)

出处:http://www.cnblogs.com/yjf512/

本文版权归yjf512和cnBlog共有,欢迎转载,但未经作者同意必须保留此段声明

你可能感兴趣的:(zeromq)