the available commands: 24 Chapter 3. Basic concepts Scrapy Documentation, Release 1.6.0 Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

the available commands: 24 Chapter 3. Basic concepts Scrapy Documentation, Release 1.7.4 Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

Scrapy tool with no arguments and it will print some usage help and the available com- mands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y- %m-%d') if date_time.year >= 2005: yield entry This would retrieve only

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry 42 Chapter 3. Basic concepts Scrapy Documentation

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry 42 Chapter 3. Basic concepts Scrapy Documentation

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider printed something like this: 24 Chapter 3. Basic concepts Scrapy Documentation, Release 2.4.1 Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl Run a spider outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first sitemap_filter(self, entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y-%m-%d') if date_time.year >= 2005: yield entry This would retrieve only entries modified on 2005 and

Scrapy tool with no arguments and it will print some usage help and the available commands: Scrapy X.Y - no active project Usage: scrapy [options] [args] Available commands: crawl outside a project. If run from inside a project it would have printed something like this: Scrapy X.Y - project: myproject Usage: scrapy [options] [args] [...] Creating projects The first entries): for entry in entries: date_time = datetime.strptime(entry['lastmod'], '%Y- %m-%d') if date_time.year >= 2005: yield entry This would retrieve only