resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . project’s settings page. It is False by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14. Coroutines 225 Scrapy Documentation, Release 2.10.1 5.14.1 1 Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): • Request callbacks. If you are using

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . project’s settings page. It is False by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14. Coroutines 225 Scrapy Documentation, Release 2.11.1 5.14.1 1 Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): • Request callbacks. If you are using

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . project’s settings page. It is False by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14. Coroutines 225 Scrapy Documentation, Release 2.11.1 5.14.1 1 Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): • Request callbacks. If you are using

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . the SCHEDULER_DEBUG setting to True in the project’s settings page. It is False by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 218 Chapter 5. Solving Documentation, Release 2.7.1 5.14.1 Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): • Request

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . project’s settings page. It is False by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14. Coroutines 223 Scrapy Documentation, Release 2.9.0 5.14.1 1 Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): • Request callbacks. If you are using any

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14.1 Supported callables The following callables may be defined as coroutines using async def, middlewares. New in version 2.7. 5.14. Coroutines 221 Scrapy Documentation, Release 2.8.0 5.14.2 General usage There are several use cases for coroutines in Scrapy. Code that would return Deferreds

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14.1 Supported callables The following callables may be defined as coroutines using async def, problems Scrapy Documentation, Release 2.11.1 5.14.2 General usage There are several use cases for coroutines in Scrapy. Code that would return Deferreds when written for previous Scrapy versions, such as

resuming crawls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213 5.14 Coroutines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . by default. 5.14 Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax. 5.14.1 Supported callables The following callables may be defined as coroutines using async def, dlewares. • Signal handlers that support deferreds. 5.14.2 Usage There are several use cases for coroutines in Scrapy. Code that would return Deferreds when written for previous Scrapy versions, such as

hardware. Jobs: pausing and resuming crawls Learn how to pause and resume crawls for large spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio set the SCHEDULER_DEBUG setting to True in the project’s settings page. It is False by default. Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax [https://docs.python org/3/reference/compound_stmts.html#async]. Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): Request callbacks

hardware. Jobs: pausing and resuming crawls Learn how to pause and resume crawls for large spiders. Coroutines Use the coroutine syntax [https://docs.python.org/3/reference/compound_stmts.html#async]. asyncio set the SCHEDULER_DEBUG setting to True in the project’s settings page. It is False by default. Coroutines New in version 2.0. Scrapy has partial support for the coroutine syntax [https://docs.python org/3/reference/compound_stmts.html#async]. Supported callables The following callables may be defined as coroutines using async def, and hence use coroutine syntax (e.g. await, async for, async with): Request callbacks