Item Images 81 6 Extending Scrapy 87 6.1 Architecture overview 87 6.2 Downloader Middleware 89 6.3 Spider Middleware 94 6.4 Extensions 98 7 Reference 103 7.1 scrapy-ctl.py 103 7.2 Requests Support for extending Scrapy by plugging your own functionality using middleware, extensions, and pipelines • Wide range of built-in middleware and extensions for handling of compression, cache, cookies, authentication INFO: Enabled extensions: ... [dmoz] INFO: Enabled scheduler middlewares: ... [dmoz] INFO: Enabled downloader middlewares: ... [dmoz] INFO: Enabled spider middlewares: ... [dmoz] INFO: Enabled item pipelines:

Error Handling 206 5.4.7 Media 239 5.4.8 Multipart Forms 250 5.4.9 Redirection 257 5.4.10 Middleware 258 5.4.11 CORS 265 5.4.12 Hooks 266 5.4.13 Routing 269 5.4.14 Inspect Module 281 5.4 access to headers and bodies through request and response objects • DRY request processing via middleware components and hooks • Strict adherence to RFCs • Idiomatic HTTP error responses • Straightforward access to headers and bodies through request and response objects • DRY request processing via middleware components and hooks • Strict adherence to RFCs • Idiomatic HTTP error responses • Straightforward

. . . . . . . . . . . . 109 6.2 Downloader Middleware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111 i 6.3 Spider Middleware . . . . . . . . . . . . . . . . . 03:51:13-0300 [tutorial] INFO: Enabled extensions: ... 2008-08-20 03:51:13-0300 [tutorial] INFO: Enabled downloader middlewares: ... 2008-08-20 03:51:13-0300 [tutorial] INFO: Enabled spider middlewares: ... 2008-08-20 [args] Available commands: crawl Start crawling a spider or URL fetch Fetch a URL using the Scrapy downloader [...] The first line will print the currently active project, if you’re inside a Scrapy project

and Middleware 35 1.5.1 Handlers 35 1.5.2 Middleware 36 1.5.3 HandlerStack 38 1.5.4 Creating a Handler 39 1.6 Testing Guzzle Clients 40 1.6.1 Mock Handler 40 1.6.2 History Middleware 40 agnostic code; i.e., no hard dependency on cURL, PHP streams, sockets, or non-blocking event loops. • Middleware system allows you to augment and compose client behavior. $client = new GuzzleHttp\Client(); $res stack middleware that are used by each request, and a base URI that allows you to send requests with relative URIs. You can find out more about client middleware in the Handlers and Middleware page of

Response - Cookies - Status Codes - Error Handling - Media - Redirection - Middleware - Hooks - Routing - Utilities - Testing - Community Guide - Get Help access to headers and bodies through request and response classes • DRY request processing via middleware components and hooks • Idiomatic HTTP error responses • Straightforward exception handling • Configure your WSGI server to load "things.app" (app is a WSGI # callable) app = falcon.API(middleware=[ AuthMiddleware(), RequireJSON(), JSONTranslator() ]) db = StorageEngine() things

complex or clever! • When in doubt, optimize for readability. #### 5.1.3 FAQ ## How do I use WSGI middleware with Falcon? Instances of falcon.API are first-class WSGI apps, so you can use the standard pattern instance with a middleware app. For example: import my_restful_service import some_ middleware app = some_ middleware.DoSomethingFancy(my_restful_service.api) See also the WSGI middleware example given a bunch of great libraries that you are welcome to use from within your responders, hooks, and middleware components. Falcon doesn’t try to dictate what you should use, since that would take away your

viii. Throwing 404 Errors ii. Middleware i. Introduction ii. Defining Middleware iii. Registering Middleware iv. Terminable Middleware iii. Controllers i. Introduction Introduction ii. Basic Controllers iii. Controller Middleware iv. Implicit Controllers v. RESTful Resource Controllers vi. Dependency Injection & Controllers vii. Route Caching default namespace can be quickly changed using the new app:name Artisan command. Controllers, middleware, and requests (a new type of class in Laravel 5.0) are now grouped under the app/Http directory

1449 6.11 File handling ..... 1456 6.12 Forms ..... 1466 6.13 Logging ..... 1562 6.14 Middleware ..... 1571 6.15 Migration Operations ..... 1582 6.16 Models ..... 1595 6.17 Paginator .. API reference | Flattened index • Advanced: Generating CSV | Generating PDF • Middleware: Overview | Built-in middleware classes ### 1.6 The template layer The template layer provides a designer-friendly Clickjacking protection • Cross Site Request Forgery protection • Cryptographic signing • Security Middleware ### 1.11 Internationalization and localization Django offers a robust internationalization and

clustered, asynchronous messaging system. • Apache ActiveMQ Artemis is an example of Message Oriented Middleware (MoM). For a description of MoMs and other messaging concepts please see the Messaging Concepts Concepts Apache ActiveMQ Artemis is an asynchronous messaging system, an example of Message Oriented Middleware, we'll just call them messaging systems in the remainder of this book. We’ll first present

Writing views ■ View decorators ■ File Uploads ■ Django shortcut functions ■ Generic views ■ Middleware ■ How to use sessions ## • Working with forms ■ HTML forms ■ Django’s role in forms Order of MIDDLEWARE • Conditional View Processing ■ The condition decorator Shortcuts for only computing one value ■ Using the decorators with other HTTP methods ■ Comparison with middleware conditional form rendering API ■ Widgets ■ Form and field validation ○ Middleware ■ Available middleware ■ Middleware ordering ○ Migration Operations ■ Schema Operations ■ Special