sns架构讨论

阅读更多

nosql    tokyocabint   mongodb

异步队列httpsqs、gearman、message queue、starling（被Kestrel替代） ，Kestrel（memcache），  ActiveMQ，ZeroMQ，

 RabbitMQ （amqp）

activemq（jms）被 Apollo替代  支持mysql持久化 消息队列使用

0MQ (ZeroMQ) 是一个轻量级消息内核。它实现了30微秒的端到端延迟和每秒超过300万的信息。它可用于C、C++、Python、.NET /Mono、Fortran和Java语言。它运行在AIX ， FreeBSD的，基于HP - UX ， Linux和MacOS下， OpenBSD系统， OpenVMS ， QNX Neutrino， Solaris和Windows操作系统。

memcached(memcached1.4.5)

 

 

搜索  sphinx luncene
图片是fastdfs（类似google的hadoop的dfs）

 

lvs，memcachedb

 

 

Message Queue Servers

Message queue servers are available in various languages, Erlang (RabbitMQ), C (beanstalkd), Ruby (Starling or Sparrow), Scala (Kestrel, Kafka) or Java (ActiveMQ). A short overview can be found here

Sparrow

• written by Alex MacCaw
• Sparrow is a lightweight queue written in Ruby that “speaks memcache”

Starling

• written by Blaine Cook at Twitter
• Starling is a Message Queue Server based on MemCached
• written in Ruby
• stores jobs in memory (message queue)
• documentation: some good tutorials, for example the railscast about starling and workling or this blog post about starling

Kestrel

• written by Robey Pointer
• Starling clone written in Scala (a port of Starling from Ruby to Scala)
• Queues are stored in memory, but logged on disk

RabbitMQ

• RabbitMQ is a Message Queue Server in Erlang
• stores jobs in memory (message queue)

Apache ActiveMQ

• ActiveMQ is an open source message broker in Java

Beanstalkd

• written by Philotic, Inc. to improve the response time of a Facebook application
• in-memory workqueue service mostly written in C
• Docu: http://nubyonrails.com/articles/about-this-blog-beanstalk-messaging-queue

Amazon SQS

• Amazon Simple Queue Service

Kafka

• Written at LinkedIn in Scala
• Used by LinkedIn to offload processing of all page and other views
• Defaults to using persistence, uses OS disk cache for hot data (has higher throughput then any of the above having persistence enabled)
• Supports both on-line as off-line processing

ZMQ

• The socket library that acts as a concurrency framework
• Faster than TCP, for clustered products and supercomputing
• Carries messages across inproc, IPC, TCP, and multicast
• Connect N-to-N via fanout, pubsub, pipeline, request-reply
• Asynch I/O for scalable multicore message-passing apps