index modules | next | Celery 2.0.3 (stable) documentation » http://cloud.github.com/downloads/ask/celery/celery_favicon_128.png Celery - Distributed Task Queue Contents: Getting Started Introduction Using the development version Overview This is a high level overview of the architecture. http://cloud.github.com/downloads/ask/celery/Celery-Overview-v4.jpg The broker pushes tasks to the worker servers With smaller tasks, you can process more tasks in parallel and the tasks won’t run long enough to block the worker from processing other waiting tasks. However, there’s a limit. Sending messages takes

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

there’s node-celery [https://github.com/mher/node-celery] and node-celery- ts [https://github.com/IBM/node-celery-ts] for Node.js, and a PHP client [https://github.com/gjedeer/celery-php]. Language interoperability Elasticsearch, Riak MongoDB, CouchDB, Couchbase, ArangoDB Amazon DynamoDB, Amazon S3 Microsoft Azure Block Blob, Microsoft Azure Cosmos DB File system Serialization pickle, json, yaml, msgpack. zlib, bzip2 the task is being executed this will contain information about the current request. Thread local storage is used. See Task Request. Task.max_retries Only applies if the task calls self.retry or if the

depending on load, or custom metrics specified by the user, used to limit memory usage in shared hosting/cloud environments or to enforce a given quality of service. Read more... . • Resource Leak Protection case the broker url may only be: ironmq:// Clouds The default cloud/region is AWS us-east-1. You can choose the IronMQ Rackspace (ORD) cloud by changing the URL to: ironmq://project_id:token@mq-rackspace-ord the task is being executed this will contain information about the current request. Thread local storage is used. See Context. Task.abstract Abstract classes are not registered, but are used as the base