a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: class MySpider(scrapy.Spider): name = 'myspider' def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. Working with relative XPaths Keep in mind that if you are nesting selectors and

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: import scrapy class MySpider(scrapy.Spider): name = "myspider" def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. Working with relative XPaths Keep in mind that if you are nesting selectors and

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: class MySpider(scrapy.Spider): name = 'myspider' def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. Working with relative XPaths Keep in mind that if you are nesting selectors and

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: import scrapy class MySpider(scrapy.Spider): name = "myspider" def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. Working with relative XPaths Keep in mind that if you are nesting selectors and

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: class MySpider(scrapy.Spider): name = 'myspider' def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. Working with relative XPaths Keep in mind that if you are nesting selectors and

genindex or modindex. • Search for information in the archives of the scrapy-users mailing list, or post a question. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: def start_requests(self): return [FormRequest("http://www.example.com/login" spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: import scrapy class MySpider(scrapy.Spider): name = "myspider" def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. 56 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 Working with

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: import scrapy class MySpider(scrapy.Spider): name = "myspider" def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. 56 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 Working with

a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: import scrapy class MySpider(scrapy.Spider): name = "myspider" def start_requests(self): spider also gives the opportunity to override adapt_response and process_results methods for pre- and post-processing purposes. CSVFeedSpider example Let’s see an example similar to the previous one, but you may want to take a look first at this XPath tutorial. Note: Some of the tips are based on this post from Zyte’s blog. 56 Chapter 3. Basic concepts Scrapy Documentation, Release 2.11.1 Working with

genindex or modindex. • Search for information in the archives of the scrapy-users mailing list, or post a question. • Ask a question in the #scrapy IRC channel. • Report bugs with Scrapy in our issue question .vote-count-post::text').extract()[0], 'body': response.css('.question .post-text').extract()[0], 5 Scrapy Documentation, Release 1.0.7 'tags': response.css('.question .post-tag::text').extract() a domain, this is the method to override. For example, if you need to start by logging in using a POST request, you could do: class MySpider(scrapy.Spider): name = 'myspider' def start_requests(self):