Redis 多数据中心双向同步 祝辰 • 携程框架架构部门 • 资深研发工程师 • 专注于 Redis 高可用系统的 研发工作 • 对分布式存储系统有所涉猎 讲师介绍 祝辰 1 开篇 2 3 4 5 目 录 CONTENTS 携程的Redis架构 分布式理论 双向/多向同步的问题 CRDT 19 世纪的通讯 “At 12:30 am on April 4th 至是跨区域的部署模式 多区域部署 Serverless 分布式存储 Redis 内存数 据库 支持多种 数据结构 支持主 从架构 缓存服务 分布式锁 消息队列 计数器 目前携程的 Redis 部署架构 通过携程的 X-Pipe 项目, 来达到 Redis 跨站点和跨区域的数据同步问题 目前已经支持上海到美国和德国的 Redis 数据同步 • 到德国法兰克福站点, 平均延迟在 176ms 176ms 左右 • 到美西站点, 平均延迟在 160ms 左右 携程业务开发的需求, 对于 Redis 的数 据存储有着强依赖. 机票的业务需要从 上游供应商处收集舱位信息, Redis 方便 的多种数据结构类型对于储存这种数据 比较方便. 同时由于供应商是在全球分布的特性, 就更需要一个能够多点写入的 Redis 集 群, 支持海外站点和国内站点同时进行读写; 并解决因此可能出现的数据一致性问题.

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

funding, so we don’t support Microsoft Windows. Please don’t open any issues related to that platform. Redis broker transports are feature complete, but there’s also support for a myriad of other experimental It supports Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer

that platform. Celery requires a message transport to send and receive messages. The RabbitMQ and Redis broker transports are feature complete, but there’s also support for a myriad of other experimental Brokers RabbitMQ, Redis, Amazon SQS, and more… Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy separating them by commas. $ pip install "celery[librabbitmq]" $ pip install "celery[librabbitmq,redis,auth,msgpack]" The following bundles are available: Serializers for using the auth security serializer