spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15.6 Using custom asyncio loops You can also use custom asyncio event loops with the Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15. asyncio 227 Scrapy Documentation, Release 2.9.0 5.15.4 Awaiting on Deferreds When Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15.4 Awaiting on Deferreds When the asyncio reactor isn’t installed, you can await on Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15.6 Using custom asyncio loops You can also use custom asyncio event loops with the Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15.6 Using custom asyncio loops You can also use custom asyncio event loops with the Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.12 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 232 Chapter 5. Solving specific problems Scrapy Documentation, Release 2.11.1 5.15.6 Using Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

spiders? Yes, see HttpAuthMiddleware. 5.1.13 Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language request header by overriding the DEFAULT_REQUEST_HEADERS you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). 5.15.4 Awaiting on Deferreds When the asyncio reactor isn’t installed, you can await on Martijn Koster’s 1996 draft specification • supports wildcard matching • uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: • Install Reppy

my spiders? Yes, see HttpAuthMiddleware. Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language [https://www.w3.org/Protocols/rfc2616/rfc2616- you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). Using custom asyncio loops You can also use custom asyncio event loops with the asyncio [https://www.robotstxt.org/norobots-rfc.txt] supports wildcard matching uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: Install Reppy

my spiders? Yes, see HttpAuthMiddleware. Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language [https://www.w3.org/Protocols/rfc2616/rfc2616- you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). Using custom asyncio loops You can also use custom asyncio event loops with the asyncio [https://www.robotstxt.org/norobots-rfc.txt] supports wildcard matching uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: Install Reppy

my spiders? Yes, see HttpAuthMiddleware. Why does Scrapy download pages in English instead of my native language? Try changing the default Accept-Language [https://www.w3.org/Protocols/rfc2616/rfc2616- you cannot use them together with Scrapy on Windows (but you should be able to use them on WSL or native Linux). Awaiting on Deferreds When the asyncio reactor isn’t installed, you can await on Deferreds [https://www.robotstxt.org/norobots-rfc.txt] supports wildcard matching uses the length based rule Native implementation, provides better speed than Protego. In order to use this parser: Install Reppy