the spider crawlers Set of crawlers started by crawl() and managed by this class. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously the spider crawlers Set of crawlers started by crawl() and managed by this class. join() Returns a deferred that is fired when all managed crawlers have completed their executions. start(stop_after_crawl=True)

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls

the spider crawlers Set of crawlers started by crawl() and managed by this class. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously the spider crawlers Set of crawlers started by crawl() and managed by this class. join() Returns a deferred that is fired when all managed crawlers have completed their executions. start(stop_after_crawl=True)

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. •If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. 200 Chapter 6. Extending Scrapy Scrapy Documentation, Release 1.5.2 create_cra loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. • If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. 206 Chapter 6. Extending Scrapy Scrapy Documentation, Release 1.6.0 create_cra loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. • If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls

(dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls loader), then creates a Crawler instance for it. join() Returns a deferred that is fired when all managed crawlers have completed their executions. stop() Stops simultaneously all the crawling jobs taking (dict) – keyword arguments to initialize the spider crawlers Set of crawlers started by crawl() and managed by this class. create_crawler(crawler_or_spidercls) Return a Crawler object. If crawler_or_spidercls