between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. • Strong extensibility (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Finally, the parse_question callback XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding dec- larations. • Strong extensibility Scrapy selectors are instances of Selector class constructed by passing text or TextResponse object. It auto- matically chooses the best parsing rules (XML vs HTML) based on input type: >>> from scrapy.selector

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially

between each request, limiting amount of concurrent requests per domain or per IP, and even using an auto-throttling extension that tries to figure out these automatically. Note: This is using feed exports XML) and storing them in multiple backends (FTP, S3, local filesystem) • Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding decla- rations. 6 Chapter 2 (instead of the standard Python console). The IPython console is much more powerful and provides smart auto-completion and colorized output, among other things. We highly recommend you install IPython, specially