project 2. Defining the Items you will extract 3. Writing a spider to crawl a site and extract Items 4. Writing an Item Pipeline to store the extracted Items Scrapy is written in Python [https://www.python xpath='//title/text()' data=u'Open Directory - Computers: Programming:'>] In [4]: response.xpath('//title/text()').extract() Out[4]: [u'Open Directory - Computers: Programming: Languages: Python: Books'] use BeautifulSoup, lxml or whatever mechanism you prefer) and generate items with the parsed data. 4. Finally, the items returned from the spider will be typically persisted to a database (in some Item

tag with id=specifications:

Writing a spider to crawl a site and extract data 3. Exporting the scraped data using the command line 4. Changing spider to recursively follow links 5. Using spider arguments Scrapy is written in Python use BeautifulSoup, lxml or whatever mechanism you prefer) and generate items with the parsed data. 4. Finally, the items returned from the spider will be typically persisted to a database (in some Item html'>Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5
Name: My image 3
Name: My image 4
Name: My image 5