index modules | next | previous | Scrapy 0.14.4 documentation » Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range spiders/ __init__.py ... These are basically: scrapy.cfg: the project configuration file tutorial/: the project’s python module, you’ll later import your code from here. tutorial/items WARNING, INFO and DEBUG. logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello’” it will appear in the Scrapy log. If

index modules | next | previous | Scrapy 0.12.0 documentation » Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range spiders/ __init__.py ... These are basically: scrapy.cfg: the project configuration file dmoz/: the project’s python module, you’ll later import your code from here. dmoz/items.py: WARNING, INFO and DEBUG. logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello’” it will appear in the Scrapy log. If

12.0 4 Chapter 1. Getting help CHAPTER 2 First steps 2.1 Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range pipelines.py settings.py spiders/ __init__.py ... These are basically: • scrapy.cfg: the project configuration file • dmoz/: the project’s python module, you’ll later import your code from here. • dmoz/items WARNING, INFO and DEBUG. • logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello”’ it will appear in the Scrapy log. If

14.4 4 Chapter 1. Getting help CHAPTER 2 First steps 2.1 Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range pipelines.py settings.py spiders/ __init__.py ... These are basically: • scrapy.cfg: the project configuration file • tutorial/: the project’s python module, you’ll later import your code from here. • tutorial/items WARNING, INFO and DEBUG. • logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello”’ it will appear in the Scrapy log. If

index modules | next | previous | Scrapy 0.16.5 documentation » Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range spiders/ __init__.py ... These are basically: scrapy.cfg: the project configuration file tutorial/: the project’s python module, you’ll later import your code from here. tutorial/items WARNING, INFO and DEBUG. logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello’” it will appear in the Scrapy log. If

16.5 4 Chapter 1. Getting help CHAPTER 2 First steps 2.1 Scrapy at a glance Scrapy is an application framework for crawling web sites and extracting structured data which can be used for a wide range pipelines.py settings.py spiders/ __init__.py ... These are basically: • scrapy.cfg: the project configuration file • tutorial/: the project’s python module, you’ll later import your code from here. • tutorial/items WARNING, INFO and DEBUG. • logstdout (boolean) – if True, all standard output (and error) of your application will be logged instead. For example if you “print ‘hello”’ it will appear in the Scrapy log. If

Chapter 1. Getting help CHAPTER TWO FIRST STEPS 2.1 Scrapy at a glance Scrapy (/skrepa/) is an application framework for crawling web sites and extracting structured data which can be used for a wide range will create a tutorial directory with the following contents: tutorial/ scrapy.cfg # deploy configuration file tutorial/ # project's Python module, you'll import your code from here __init__.py items favor of the standalone scrapyd-deploy. See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy

Chapter 1. Getting help CHAPTER TWO FIRST STEPS 2.1 Scrapy at a glance Scrapy (/skrepa/) is an application framework for crawling web sites and extracting structured data which can be used for a wide range will create a tutorial directory with the following contents: tutorial/ scrapy.cfg # deploy configuration file tutorial/ # project's Python module, you'll import your code from here __init__.py items favor of the standalone scrapyd-deploy. See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy

Chapter 1. Getting help CHAPTER TWO FIRST STEPS 2.1 Scrapy at a glance Scrapy (/skrepa/) is an application framework for crawling web sites and extracting structured data which can be used for a wide range will create a tutorial directory with the following contents: tutorial/ scrapy.cfg # deploy configuration file tutorial/ # project's Python module, you'll import your code from here __init__.py items favor of the standalone scrapyd-deploy. See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy

Chapter 1. Getting help CHAPTER TWO FIRST STEPS 2.1 Scrapy at a glance Scrapy (/skrepa/) is an application framework for crawling web sites and extracting structured data which can be used for a wide range will create a tutorial directory with the following contents: tutorial/ scrapy.cfg # deploy configuration file tutorial/ # project's Python module, you'll import your code from here __init__.py items favor of the standalone scrapyd-deploy. See Deploying your project.) 3.1.1 Configuration settings Scrapy will look for configuration parameters in ini-style scrapy.cfg files in standard locations: 1. /etc/scrapy