7/1/2017 基于amqp实现的golang消息队列MaxQ http://192.168.10.11:3999/maxq.slide#1 1/22 基于amqp实现的golang消息队列 MaxQ 2017-07-01 张培培 饿了么－基础框架组 7/1/2017 基于amqp实现的golang消息队列MaxQ http://192.168.10.11:3999/maxq.slide#1 2. IPC消息队列 3. AMQP协议 4. MaxQ架构模型 5. MaxQ相关特性 6. 使用场景和案例 7/1/2017 基于amqp实现的golang消息队列MaxQ http://192.168.10.11:3999/maxq.slide#1 3/22 1. 队列 跟消息队列相比，有哪些共性？ 7/1/2017 基于amqp实现的golang消息队列MaxQ 7/1/2017 基于amqp实现的golang消息队列MaxQ http://192.168.10.11:3999/maxq.slide#1 5/22 2. IPC消息队列 跟消息队列相比，有哪些共性？ 7/1/2017 基于amqp实现的golang消息队列MaxQ http://192.168.10.11:3999/maxq.slide#1 6/22 3. AMQP(Advanced

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' Highly Available Workers Concurrency prefork (multiprocessing), Eventlet, gevent threads/single threaded Result Stores AMQP, Redis memcached, MongoDB SQLAlchemy, Django ORM Apache Cassandra Serialization pickle, json, yaml version With pip The Celery development version also requires the development versions of kombu, amqp and billiard. You can install the latest snapshot of these using the following pip commands: $ pip

org/pypi/celery/ Source: http://github.com/ask/celery/ Keywords: task queue, job queue, asynchronous, rabbitmq, amqp, redis, python, webhooks, queue, distributed – Celery is an open source asynchronous task queue/job retrieve it later, or ignore it. Result Stores Database, MongoDB, Redis, Tokyo Tyrant, Cassandra, or AMQP (message notification). Webhooks Your tasks can also be HTTP callbacks, enabling cross- language bursts of traffic. Rate limits can be set for each task type, or globally for all. Routing Using AMQP’s flexible routing model you can route tasks to different workers, or select different message topologies

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' • Highly Available Workers and Getting Started 7 Celery Documentation, Release 3.1.25 • threads/single threaded • Result Stores • AMQP, Redis • memcached, MongoDB • SQLAlchemy, Django ORM • Apache Cassandra • Serialization • pickle, version With pip The Celery development version also requires the development versions of kombu, amqp and billiard. You can install the latest snapshot of these using the following pip commands: $ pip

org/pypi/celery/ Source: http://github.com/ask/celery/ Keywords: task queue, job queue, asynchronous, rabbitmq, amqp, redis, python, webhooks, queue, distributed – Celery is an open source asynchronous task queue/job retrieve it later, or ignore it. Result Stores Database, MongoDB, Redis, Tokyo Tyrant, Cassandra, or AMQP (message notification). Webhooks Your tasks can also be HTTP callbacks, enabling cross- language bursts of traffic. Rate limits can be set for each task type, or globally for all. Routing Using AMQP’s flexible routing model you can route tasks to different workers, or select different message topologies

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' Highly Available Workers more… Concurrency prefork (multiprocessing), Eventlet, gevent solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch Serialization pickle, json requires the development versions of kombu [https://pypi.python.org/pypi/kombu/], amqp [https://pypi.python.org/pypi/amqp/], billiard [https://pypi.python.org/pypi/billiard/], and vine [https://pypi.python

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' Highly Available Workers more… Concurrency prefork (multiprocessing), Eventlet, gevent solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch Serialization pickle, json requires the development versions of kombu [https://pypi.python.org/pypi/kombu/], amqp [https://pypi.python.org/pypi/amqp/], billiard [https://pypi.python.org/pypi/billiard/], and vine [https://pypi.python

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' Highly Available Workers more… Concurrency prefork (multiprocessing), Eventlet, gevent solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch Serialization pickle, json requires the development versions of kombu [https://pypi.python.org/pypi/kombu/], amqp [https://pypi.python.org/pypi/amqp/], billiard [https://pypi.python.org/pypi/billiard/], and vine [https://pypi.python

the simplest applications you can make: from celery import Celery app = Celery('hello', broker='amqp://guest@localhost//') @app.task def hello(): return 'hello world' Highly Available Workers more… Concurrency prefork (multiprocessing), Eventlet, gevent solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch Serialization pickle, json requires the development versions of kombu [https://pypi.python.org/pypi/kombu/], amqp [https://pypi.python.org/pypi/amqp/], billiard [https://pypi.python.org/pypi/billiard/], and vine [https://pypi.python

org/pypi/celery/ Source: http://github.com/ask/celery/ Keywords: task queue, job queue, asynchronous, rabbitmq, amqp, redis, python, webhooks, queue, distributed – Celery is an open source asynchronous task queue/job retrieve it later, or ignore it. Result Stores Database, MongoDB, Redis, Tokyo Tyrant, Cassandra, or AMQP (message notification). Webhooks Your tasks can also be HTTP callbacks, enabling cross- language bursts of traffic. Rate limits can be set for each task type, or globally for all. Routing Using AMQP’s flexible routing model you can route tasks to different workers, or select different message topologies