css('div.quote'): yield { 'text': quote.css('span.text::text').extract_first(), 'author': quote.xpath('span/small/text()').extract_first(), } next_page if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

response): for quote in response.css('div.quote'): yield { 'text': quote.css('span.text::text').get(), 'author': quote.xpath('span/small/text()').get(), } (continues on next page) 5 Scrapy Documentation a::attr("href")').get() if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has ˓→not pleasure

response): for quote in response.css('div.quote'): yield { 'text': quote.css('span.text::text').get(), 'author': quote.xpath('span/small/text()').get(), } next_page = response.css('li.next a::attr("href")') a::attr("href")').get() if next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider list of the quotes in JSON format, containing text and author, looking like this (reformatted here for better readability): [{ "author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure

quote in response.css('div.quote'): yield { 'author': quote.xpath('span/small/text()').get(), 'text': quote.css('span.text::text').get(), } next_page = response.css('li.next a::attr("href")').get() if next_page next_page is not None: yield response.follow(next_page, self.parse) Put this in a text file, name it to something like quotes_spider.py and run the spider using the runspider command: scrapy runspider quotes.jl file a list of the quotes in JSON Lines format, containing text and author, looking like this: {"author": "Jane Austen", "text": "\u201cThe person, be it gentleman or lady, who has␣ ˓→not pleasure