. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133 6.5 Core API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . item[’desc’] = site.xpath(’text()’).extract() items.append(item) return items Note: You can find a fully-functional variant of this spider in the dirbot project available at https://github.com/scrapy/dirbot Now intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130 6.5 Core API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . item[’desc’] = site.xpath(’text()’).extract() items.append(item) return items Note: You can find a fully-functional variant of this spider in the dirbot project available at https://github.com/scrapy/dirbot Now intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 6.5 Core API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Scrapy Documentation, Release 0.18.4 items.append(item) return items Note: You can find a fully-functional variant of this spider in the dirbot project available at https://github.com/scrapy/dirbot Now intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Core API Use it on extensions and middlewares to extend Scrapy functionality Reference Command line xpath('text()').extract() items.append(item) return items Note You can find a fully-functional variant of this spider in the dirbot [https://github.com/scrapy/dirbot] project available at https://github intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Core API Use it on extensions and middlewares to extend Scrapy functionality Reference Command line select('text()').extract() items.append(item) return items Note You can find a fully-functional variant of this spider in the dirbot [https://github.com/scrapy/dirbot] project available at https://github intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137 6.5 Core API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Release 0.24.6 item['desc'] = sel.xpath('text()').extract() yield item Note: You can find a fully-functional variant of this spider in the dirbot project available at https://github.com/scrapy/dirbot Now intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Core API Use it on extensions and middlewares to extend Scrapy functionality Reference Command line xpath('text()').extract() items.append(item) return items Note You can find a fully-functional variant of this spider in the dirbot [https://github.com/scrapy/dirbot] project available at https://github intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171 6.5 Core API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xpath('a/@href').extract() item['desc'] = sel.xpath('text()').extract() yield item Note: You can find a fully-functional variant of this spider in the dirbot project available at https://github.com/scrapy/ dirbot Now intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Core API Use it on extensions and middlewares to extend Scrapy functionality Reference Command line item['desc'] = sel.xpath('text()').extract() yield item Note You can find a fully-functional variant of this spider in the dirbot [https://github.com/scrapy/dirbot] project available at https://github intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated

Customize the input and output of your spiders. Extensions Extend Scrapy with your custom functionality Core API Use it on extensions and middlewares to extend Scrapy functionality Signals See all available item['desc'] = sel.xpath('text()').extract() yield item Note You can find a fully-functional variant of this spider in the dirbot [https://github.com/scrapy/dirbot] project available at https://github intended to perform any last time processing required before returning the results to the framework core, for example setting the item IDs. It receives a list of results and the response which originated