method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiving a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiving a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation

method of the Spider. Upon receiving a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name xpath() or .css() methods, .re() returns a list of unicode strings. So you can’t construct nested .re() calls. Here’s an example used to extract image names from the HTML code above: >>> response.xpath('//a[contains(@href

method of the Spider. Upon receiving a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. name A string which defines the name xpath() or .css() methods, .re() returns a list of unicode strings. So you can’t construct nested .re() calls. Here’s an example used to extract image names from the HTML code above: >>> response.xpath('//a[contains(@href

method of the Spider. Upon receiv- ing a response for each one, it instantiates Response objects and calls the callback method associated with the request (in this case, the parse method) passing the response default start_requests() implementation which sends requests from the start_urls spider attribute and calls the spider’s method parse for each of the resulting responses. 3.2. Spiders 35 Scrapy Documentation Requests to crawl for this spider. It is called by Scrapy when the spider is opened for scraping. Scrapy calls it only once, so it is safe to implement start_requests() as a generator. The default implementation