with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. flags (list) – is a list containing the initial values for extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. • An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). • body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. • flags (list) – is a list containing the initial values xpath('a/@href').extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. • An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging 3 • body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. • meta (dict) – the initial values for the Response.meta xpath('a/@href').extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. • An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). • body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. • flags (list) – is a list containing the initial values xpath('a/@href').extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging 200. body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. meta (dict) – the initial values for the Response.meta attribute extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. • An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging To access the decoded text as str (unicode in Python 2) you can use response.text from an encoding-aware Response subclass, such as TextResponse. • flags (list) – is a list containing the initial values xpath('a/@href').extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. flags (list) – is a list containing the initial values for extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. flags (list) – is a list containing the initial values for extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. • An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). • body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. • flags (list) – is a list containing the initial values xpath('a/@href').extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the

with helper methods to extract using regular expressions. An interactive shell console (IPython aware) for trying out the CSS and XPath expressions to scrape data, very useful when writing or debugging headers). body (str) – the response body. It must be str, not unicode, unless you’re using a encoding-aware Response subclass, such as TextResponse. flags (list) – is a list containing the initial values for extract() item['description'] = link.xpath('font[2]/text()').extract() yield item Be aware that you may find some elements which appear in Firebug but not in the original HTML, such as the