json Exporter used: JsonItemExporter See this warning if you’re using JSON with large feeds JSON lines FEED_FORMAT: jsonlines Exporter used: JsonLinesItemExporter CSV FEED_FORMAT: csv Exporter used: CsvItemExporter XML FEED_FORMAT: xml Exporter used: XmlItemExporter Pickle FEED_FORMAT: pickle Exporter used: PickleItemExporter Marshal FEED_FORMAT: marshal Exporter used: MarshalItemExporter Storages are paths to Item exporter classes. FEED_EXPORTERS_BASE Default: FEED_EXPORTERS_BASE = { 'json': 'scrapy.contrib.exporter.JsonItemExporter', 'jsonlines': 'scrapy.contrib.exporter.JsonLinesItemExporter'

JSON • FEED_FORMAT: json • Exporter used: JsonItemExporter • See this warning if you’re using JSON with large feeds JSON lines • FEED_FORMAT: jsonlines • Exporter used: JsonLinesItemExporter CSV CSV • FEED_FORMAT: csv • Exporter used: CsvItemExporter 58 Chapter 3. Basic concepts Scrapy Documentation, Release 0.14.4 XML • FEED_FORMAT: xml • Exporter used: XmlItemExporter Pickle • FEED_FORMAT: FEED_FORMAT: pickle • Exporter used: PickleItemExporter Marshal • FEED_FORMAT: marshal • Exporter used: MarshalItemExporter 3.9.2 Storages When using the feed exports you define where to store the feed

JSON • FEED_FORMAT: json • Exporter used: JsonItemExporter • See this warning if you’re using JSON with large feeds JSON lines • FEED_FORMAT: jsonlines • Exporter used: JsonLinesItemExporter CSV CSV • FEED_FORMAT: csv • Exporter used: CsvItemExporter XML • FEED_FORMAT: xml • Exporter used: XmlItemExporter 3.9.2 Storages When using the feed exports you define where to store the feed using are paths to Item exporter classes. FEED_EXPORTERS_BASE Default: FEED_EXPORTERS_BASE = { 'json': 'scrapy.contrib.exporter.JsonItemExporter', 'jsonlines': 'scrapy.contrib.exporter.JsonLinesItemExporter'

json Exporter used: JsonItemExporter See this warning if you’re using JSON with large feeds JSON lines FEED_FORMAT: jsonlines Exporter used: JsonLinesItemExporter CSV FEED_FORMAT: csv Exporter used: used: CsvItemExporter XML FEED_FORMAT: xml Exporter used: XmlItemExporter Storages When using the feed exports you define where to store the feed using a URI [http://en.wikipedia.org/wiki/Uniform_Resource_Identifier] are paths to Item exporter classes. FEED_EXPORTERS_BASE Default: FEED_EXPORTERS_BASE = { 'json': 'scrapy.contrib.exporter.JsonItemExporter', 'jsonlines': 'scrapy.contrib.exporter.JsonLinesItemExporter'

JSON • FEED_FORMAT: json • Exporter used: JsonItemExporter • See this warning if you’re using JSON with large feeds JSON lines • FEED_FORMAT: jsonlines • Exporter used: JsonLinesItemExporter CSV CSV • FEED_FORMAT: csv • Exporter used: CsvItemExporter XML • FEED_FORMAT: xml • Exporter used: XmlItemExporter Pickle • FEED_FORMAT: pickle • Exporter used: PickleItemExporter Marshal • FEED_FORMAT: FEED_FORMAT: marshal • Exporter used: MarshalItemExporter 60 Chapter 3. Basic concepts Scrapy Documentation, Release 0.18.4 3.9.2 Storages When using the feed exports you define where to store the feed

JSON • FEED_FORMAT: json • Exporter used: JsonItemExporter • See this warning if you’re using JSON with large feeds JSON lines • FEED_FORMAT: jsonlines • Exporter used: JsonLinesItemExporter CSV CSV • FEED_FORMAT: csv • Exporter used: CsvItemExporter XML • FEED_FORMAT: xml • Exporter used: XmlItemExporter Pickle • FEED_FORMAT: pickle • Exporter used: PickleItemExporter 3.9. Feed exports exports 57 Scrapy Documentation, Release 0.16.5 Marshal • FEED_FORMAT: marshal • Exporter used: MarshalItemExporter 3.9.2 Storages When using the feed exports you define where to store the feed using

json Exporter used: JsonItemExporter See this warning if you’re using JSON with large feeds JSON lines FEED_FORMAT: jsonlines Exporter used: JsonLinesItemExporter CSV FEED_FORMAT: csv Exporter used: CsvItemExporter XML FEED_FORMAT: xml Exporter used: XmlItemExporter Pickle FEED_FORMAT: pickle Exporter used: PickleItemExporter Marshal FEED_FORMAT: marshal Exporter used: MarshalItemExporter Storages are paths to Item exporter classes. FEED_EXPORTERS_BASE Default: FEED_EXPORTERS_BASE = { 'json': 'scrapy.contrib.exporter.JsonItemExporter', 'jsonlines': 'scrapy.contrib.exporter.JsonLinesItemExporter'

format to use for exporting. Here is a list of all available formats. Click on the respective Item Exporter to get more info. xml: uses a XmlItemExporter csv: uses a CsvItemExporter csv_headers: uses a CsvItemExporter The name of the item fields that will be exported. This will be use for the fields_to_export Item Exporter attribute. If None, all fields will be exported. EXPORT_EMPTY Default: False Whether to export for the export_empty_fields Item Exporter attribute. EXPORT_ENCODING Default: 'utf-8' The encoding to use for exporting. Ths will be used for the encoding Item Exporter attribute. © Copyright 2008-2010

json Exporter used: JsonItemExporter See this warning if you’re using JSON with large feeds JSON lines FEED_FORMAT: jsonlines Exporter used: JsonLinesItemExporter CSV FEED_FORMAT: csv Exporter used: CsvItemExporter XML FEED_FORMAT: xml Exporter used: XmlItemExporter Pickle FEED_FORMAT: pickle Exporter used: PickleItemExporter Marshal FEED_FORMAT: marshal Exporter used: MarshalItemExporter Storages are paths to Item exporter classes. FEED_EXPORTERS_BASE Default: FEED_EXPORTERS_BASE = { 'json': 'scrapy.contrib.exporter.JsonItemExporter', 'jsonlines': 'scrapy.contrib.exporter.JsonLinesItemExporter'

JSON • FEED_FORMAT: json • Exporter used: JsonItemExporter • See this warning if you’re using JSON with large feeds JSON lines • FEED_FORMAT: jsonlines • Exporter used: JsonLinesItemExporter CSV CSV • FEED_FORMAT: csv • Exporter used: CsvItemExporter 64 Chapter 3. Basic concepts Scrapy Documentation, Release 0.24.6 XML • FEED_FORMAT: xml • Exporter used: XmlItemExporter Pickle • FEED_FORMAT: FEED_FORMAT: pickle • Exporter used: PickleItemExporter Marshal • FEED_FORMAT: marshal • Exporter used: MarshalItemExporter 3.8.2 Storages When using the feed exports you define where to store the feed