{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

genindex or modindex. • Search for information in the archives of the scrapy-users mailing list, or post a question. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue crawler. The purpose of this document is to introduce you to the concepts behind Scrapy so you can get an idea of how it works and decide if Scrapy is what you need. When you’re ready to start a project multiple spider metrics, useful for monitoring the performance of your spiders and detecting when they get broken • An Interactive shell console for trying XPaths, very useful for writing and debugging your

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

{ "author": quote.xpath("span/small/text()").get(), "text": quote.css("span.text::text").get(), } next_page = response.css('li.next a::attr("href")').get() if next_page is not None: yield response.follow(next_page install Scrapy on Ubuntu (or Ubuntu-based) systems, you need to install these dependencies: sudo apt-get install python3 python3-dev python3-pip libxml2-dev libxslt1-dev zlib1g-dev␣ ˓→libffi-dev libssl-dev has no attribute ‘OP_NO_TLSv1_1’ After you install or upgrade Scrapy, Twisted or pyOpenSSL, you may get an exception with the following traceback: [...] File "[...]/site-packages/twisted/protocols/tls.py"

the archives of the scrapy-users mailing list [http://groups.google.com/group/scrapy-users/], or post a question [http://groups.google.com/group/scrapy-users/]. Ask a question in the #scrapy IRC channel steps Scrapy at a glance Understand what Scrapy is and how it can help you. Installation guide Get Scrapy installed on your computer. Scrapy Tutorial Write your first Scrapy project. Examples Learn interactive environment. Item Loaders Populate your items with the extracted data. Item Pipeline Post-process and store your scraped data. Feed exports Output your scraped data using different formats