Improving Go Backend Developer Experience in Grab Chew Chee Ming Grab Engineering Manager, Developer Experience ???????????? Durian eater in Dali, Yunnan ? Runs & Love the outdoors ☕ Makes and Breaks flow of engineers, lag time leads to lower productivity ● 1 min increased build time could result in landing code 1 hour later ● Build times too long p50 ~15mins p90 ~38mins ● Start

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Concurrency prefork (multiprocessing), Eventlet, gevent thread (multithreaded) solo (single threaded) Result Stores AMQP, Redis Memcached, SQLAlchemy, Django ORM Apache Cassandra, Elasticsearch, Riak MongoDB transport or as a result backend. for using Amazon SQS as a message transport (experimental). for using the task_remote_tracebacks feature. for using Memcached as a result backend (using pylibmc [https://pypi Memcached as a result backend (pure-Python implementation). for using Apache Cassandra as a result backend with DataStax driver. for using Couchbase as a result backend. for using ArangoDB as a result backend

Release 4.3.0 • Concurrency • prefork (multiprocessing), • Eventlet, gevent • solo (single threaded) • Result Stores • AMQP, Redis • Memcached, • SQLAlchemy, Django ORM • Apache Cassandra, Elasticsearch • Serialization Celery Documentation, Release 4.3.0 celery[redis] for using Redis as a message transport or as a result backend. celery[sqs] for using Amazon SQS as a message transport (experimental). celery[tblib] for Memcached as a result backend (using pylibmc) celery[pymemcache] for using Memcached as a result backend (pure-Python implementation). celery[cassandra] for using Apache Cassandra as a result backend with DataStax