log(f'Saved file {filename}') As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)').get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css('li.next a').attrib['href'] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css('ul.pager a::attr(href)'): yield response.follow(href, callback=self

log(f"Saved file {filename}") As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)").get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css("li.next a").attrib["href"] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css("ul.pager a::attr(href)"): yield response.follow(href, callback=self

log(f'Saved file {filename}') As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)').get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css('li.next a').attrib['href'] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css('ul.pager a::attr(href)'): yield response.follow(href, callback=self

log(f"Saved file {filename}") As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)").get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css("li.next a").attrib["href"] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css("ul.pager a::attr(href)"): yield response.follow(href, callback=self

log(f'Saved file {filename}') As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)').get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css('li.next a').attrib['href'] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css('ul.pager a::attr(href)'): yield response.follow(href, callback=self

log(f"Saved file {filename}") As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)").get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css("li.next a").attrib["href"] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css("ul.pager a::attr(href)"): yield response.follow(href, callback=self

log(f"Saved file {filename}") As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)").get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css("li.next a").attrib["href"] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css("ul.pager a::attr(href)"): yield response.follow(href, callback=self

log(f"Saved file {filename}") As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)").get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css("li.next a").attrib["href"] '/page/2/' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css("ul.pager a::attr(href)"): yield response.follow(href, callback=self

log('Saved file %s' % filename) As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)').get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css('li.next a').attrib['href'] '/page/2' Let’s see now our spider modified pass a selector to response.follow instead of a string; this selector should extract necessary attributes: for href in response.css('li.next a::attr(href)'): yield response.follow(href, callback=self

log('Saved file %s' % filename) As you can see, our Spider subclasses scrapy.Spider and defines some attributes and methods: • name: identifies the Spider. It must be unique within a project, that is, you can’t a::attr(href)').get() '/page/2/' There is also an attrib property available (see Selecting element attributes for more): >>> response.css('li.next a').attrib['href'] '/page/2' Let’s see now our spider modified json -a tag=humor These arguments are passed to the Spider’s __init__ method and become spider attributes by default. In this example, the value provided for the tag argument will be available via self