RabbitMQ之消息发布订阅与信息持久化技术
信息发布与订阅
Rabbit的核心组件包含Queue(消息队列)和Exchanges两部分，Exchange的主要部分就是对信息进行路由，通过将消息队列绑定到Exchange上，则可以实现订阅形式的消息发布及Publish/Subscribe在这种模式下消息发布者只需要将信息发布到相应的Exchange中，而Exchange则自动将信息分发到不同的Queue当中。
这种模式下Exchange充当的角色
在命令行中可以使用
sudo rabbitmqctl list_exchanges
sudo rabbitmqctl list_bindings
分别查看当前系统种存在的Exchange和Exchange上绑定的Queue信息。
消息发布者EmitLog.java
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
public class EmitLog {
private static final String EXCHANGE_NAME="logs";
public static void main(String[] args) throws java.io.IOException{
//创建链接工厂
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("localhost");
//创建链接
Connection connection = factory.newConnection();
//创建信息管道
Channel channel = connection.createChannel();
//生命Exchange 非持久化
channel.exchangeDeclare(EXCHANGE_NAME, "fanout");
String message = "Message "+Math.random();
//第一个参数是对应的Exchange名称,如果为空则使用默认Exchange
channel.basicPublish(EXCHANGE_NAME, "", null, message.getBytes());
System.out.println("[x] Sent '"+message+"'");
//关闭链接
channel.close();
connection.close();
}
}
消息消费者ReceiveLogs.java
import java.io.IOException;
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
import com.rabbitmq.client.ConsumerCancelledException;
import com.rabbitmq.client.QueueingConsumer;
import com.rabbitmq.client.ShutdownSignalException;
public class ReceiveLogs {
private static final String EXCHANGE_NAME = "logs";
public static void main(String[] args) throws IOException, ShutdownSignalException, ConsumerCancelledException, InterruptedException {
//创建链接工厂
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("localhost");
//创建链接
Connection connection = factory.newConnection();
//创建消息管道
Channel channel = connection.createChannel();
//声明Exchange
channel.exchangeDeclare(EXCHANGE_NAME, "fanout");
//利用系统自动声明一个非持久化的消息队列，并返回唯一的队列名称
String queueName = channel.queueDeclare().getQueue();
//将消息队列绑定到Exchange
channel.queueBind(queueName, EXCHANGE_NAME, "");
System.out.println(" [*] Waiting for messages. To exit press CTRL+C");
//声明一个消费者
QueueingConsumer consumer = new QueueingConsumer(channel);
channel.basicConsume(queueName, true, consumer);
while (true) {
//循环获取信息
QueueingConsumer.Delivery delivery = consumer.nextDelivery();
String message = new String(delivery.getBody());
System.out.println(" [x] Received '" + message + "'");
}
}
}
运行时启动一个EmitLog.java多个ReceiveLogs.java则可以看到发布者每次发布信息，只要绑定到了相应Exchange的消费者都可以获取到信息。
RabbitMQ信息持久化技术
上面的例子中我们实现了Publisher/Subscribe的消息分发方式，但是其中存在一些问题。比如当我们运行一个ReceiveLog都对应了一个特定的消息队列，可以利用list_queues进行查看，同时这些消息队列是帮到到名为logs的Exchange中，这是发布消息每个消费者都可以接收到，可以当关闭ReceiveLog程序后这些消息队列就都会自动销毁，因为他们是非持久化的。同样对于EmitLog程序也一样，每次关闭后之前生命的Exchange也将自动销毁。
这就产生了一些问题。如果当ReceiveLog为运行时，此时就并没有一个消息队列是绑定到Exchange上的，在发布消息后再启动ReceiveLog程序是无法接受到之前发布的信息。这就是为什么要进行消息的持久化。
通过持久化技术，我们可以生命一个持久化的Exchange，以及持久化的Queue这样，在把Queue绑定到Exchange后，即使没有消费者程序运行，信息依然能保存在Queue当中，当下次启动消费者程序时依然能获取到发布的所有信息。就好比当一个消费者程序在执行消息序列中的任务时，如果突然出现了异常那么重新启动后，依然能从上一次发生错误的位置继续运行，对于某些需要一个有序性和连续性的操作，这点显的尤为重要。
下面还是给出一个例子，在持久化过程中，可以借助list_exchanges,list_bindings,list_queues来查看服务器中相关信息来帮组分析过程。
Publisher.java
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
import com.rabbitmq.client.MessageProperties;
public class Publisher {
private static final String EXCHANGE_NAME="persi";//定义Exchange名称
private static final boolean durable = true;//消息队列持久化
public static void main(String[] args) throws java.io.IOException {
ConnectionFactory factory = new ConnectionFactory();//创建链接工厂
factory.setHost("localhost");
Connection connection = factory.newConnection();//创建链接
Channel channel = connection.createChannel();//创建信息通道
channel.exchangeDeclare(EXCHANGE_NAME, "fanout", durable);//创建交换机并生命持久化
String message = "Hello Wrold "+Math.random();
//消息的持久化
channel.basicPublish(EXCHANGE_NAME, "", MessageProperties.PERSISTENT_TEXT_PLAIN, message.getBytes());
System.out.println("[x] Sent '" + message + "'");
channel.close();
connection.close();
}
}
Subscriber.java
public class Subscriber {
//private static final String[] QUEUE_NAMES= {"que_001","que_002","que_003","que_004","que_005"};
private static final String[] QUEUE_NAMES= {"que_006","que_007","que_008","que_009","que_0010"};
public static void main(String[] args){
for(int i=0;i<QUEUE_NAMES.length;i++){
SubscriberThead sub = new SubscriberThead(QUEUE_NAMES[i]);
Thread t = new Thread(sub);
t.start();
}
}
}
SubscriberThead.java
import com.rabbitmq.client.Channel;
import com.rabbitmq.client.Connection;
import com.rabbitmq.client.ConnectionFactory;
import com.rabbitmq.client.QueueingConsumer;
import com.rabbitmq.client.AMQP.Queue.DeclareOk;
public class SubscriberThead implements Runnable {
private String queue_name = null;
private static final String EXCHANGE_NAME = "persi";// 定义交换机名称
private static final boolean durable = true;//消息队列持久化
public SubscriberThead(String queue_name) {
this.queue_name = queue_name;
}
@Override
public void run() {
try{
ConnectionFactory factory = new ConnectionFactory();
factory.setHost("localhost");
Connection connection = factory.newConnection();
Channel channel = connection.createChannel();
channel.exchangeDeclare(EXCHANGE_NAME, "fanout", durable);
DeclareOk ok = channel.queueDeclare(queue_name, durable, false,
false, null);
String queueName = ok.getQueue();
channel.queueBind(queueName, EXCHANGE_NAME, "");
System.out.println(" ["+queue_name+"] Waiting for messages. To exit press CTRL+C");
channel.basicQos(1);//消息分发处理
QueueingConsumer consumer = new QueueingConsumer(channel);
channel.basicConsume(queueName, false, consumer);
while (true) {
Thread.sleep(2000);
QueueingConsumer.Delivery delivery = consumer.nextDelivery();
String message = new String(delivery.getBody());
System.out.println(" ["+queue_name+"] Received '" + message + "'");
channel.basicAck(delivery.getEnvelope().getDeliveryTag(), false);
}
}catch(Exception e){
e.printStackTrace();
}
}
}
通过持久化处理后rabbitMQ将保存Exchange信息以及Queue信息，甚至在rabbitMQ服务器关闭后信息依然能保存，这样就提供了消息传递的可靠性