response.css('div.quote'): yield { 'text': quote.css('span.text::text').get(), 'author': quote.xpath('span/small/text()').get(), } (continues on next page) 5 Scrapy Documentation, Release 1.6.0 (continued (continued from previous page) next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something tools and scripts), and still install packages normally with pip (without sudo and the likes). To get started with virtual environments, see virtualenv installation instructions. To install it globally

yield { 'text': quote.css('span.text::text').get(), 'author': quote.xpath('span/small/text()').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response tools and scripts), and still install packages normally with pip (without sudo and the likes). To get started with virtual environments, see virtualenv installation instructions. To install it globally install scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev libffi- ˓→dev libssl-dev • python-dev

response.css('div.quote'): yield { 'text': quote.css('span.text::text').get(), 'author': quote.xpath('span/small/text()').get(), } (continues on next page) 5 Scrapy Documentation, Release 1.7.4 (continued (continued from previous page) next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something tools and scripts), and still install packages normally with pip (without sudo and the likes). To get started with virtual environments, see virtualenv installation instructions. To install it globally

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g- ˓→dev libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g- ˓→dev libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g- ˓→dev libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g- ˓→dev libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g- ˓→dev libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"