Scrapy 0.18 Documentationis set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified header (heuristic used by Firefox) • Compute current age from Age response header 6.2. Downloader Middleware 119 Scrapy Documentation, Release 0.18.4 • Compute current age from Date header • Revalidate • move buffer pointing to start of file before computing checksum. refs #92 (commit 6a5bef2) • Compute image checksum before persisting images. closes #92 (commit 9817df1) • remove leaking references0 码力 | 201 页 | 929.55 KB | 1 年前3- Scrapy 0.22 Documentationis set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) • Compute current age from Age response header • Compute current age from Date header • Revalidate stale responses based on Last-Modified response header • move buffer pointing to start of file before computing checksum. refs #92 (commit 6a5bef2) • Compute image checksum before persisting images. closes #92 (commit 9817df1) • remove leaking references0 码力 | 199 页 | 926.97 KB | 1 年前3
- Scrapy 0.20 Documentationis set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified header (heuristic used by Firefox) • Compute current age from Age response header 6.2. Downloader Middleware 121 Scrapy Documentation, Release 0.20.2 • Compute current age from Date header • Revalidate • move buffer pointing to start of file before computing checksum. refs #92 (commit 6a5bef2) • Compute image checksum before persisting images. closes #92 (commit 9817df1) • remove leaking references0 码力 | 197 页 | 917.28 KB | 1 年前3
- Scrapy 1.2 DocumentationCONCURRENCY concurrent requests on average to each remote website. It uses download latency to compute the delays. The main idea is the following: if a server needs latency seconds to respond, a client is set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) • Compute current age from Age response header • Compute current age from Date header • Revalidate stale responses based on Last-Modified response header0 码力 | 266 页 | 1.10 MB | 1 年前3
- Scrapy 1.1 DocumentationCONCURRENCY concurrent requests on average to each remote website. It uses download latency to compute the delays. The main idea is the following: if a server needs latency seconds to respond, a client is set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) • Compute current age from Age response header • Compute current age from Date header • Revalidate stale responses based on Last-Modified response header0 码力 | 260 页 | 1.12 MB | 1 年前3
- Scrapy 1.3 DocumentationCONCURRENCY concurrent requests on average to each remote website. It uses download latency to compute the delays. The main idea is the following: if a server needs latency seconds to respond, a client is set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) • Compute current age from Age response header • Compute current age from Date header • Revalidate stale responses based on Last-Modified response header0 码力 | 272 页 | 1.11 MB | 1 年前3
Scrapy 0.20 Documentationdirective is set even for fresh responses Compute freshness lifetime from max-age cache-control directive Compute freshness lifetime from Expires response header Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) Compute current age from Age response header Compute current age from Date header Revalidate stale responses based on Last-Modified response header Revalidate computing checksum. refs #92 (commit 6a5bef2 [https://github.com/scrapy/scrapy/commit/6a5bef2]) Compute image checksum before persisting images. closes #92 (commit 9817df1 [https://github.com/scrapy/s0 码力 | 276 页 | 564.53 KB | 1 年前3- Scrapy 0.18 Documentationdirective is set even for fresh responses Compute freshness lifetime from max-age cache-control directive Compute freshness lifetime from Expires response header Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) Compute current age from Age response header Compute current age from Date header Revalidate stale responses based on Last-Modified response header Revalidate computing checksum. refs #92 (commit 6a5bef2 [https://github.com/scrapy/scrapy/commit/6a5bef2]) Compute image checksum before persisting images. closes #92 (commit 9817df1 [https://github.com/scrapy/s0 码力 | 273 页 | 523.49 KB | 1 年前3
- Scrapy 0.24 Documentationis set even for fresh responses • Compute freshness lifetime from max-age cache-control directive • Compute freshness lifetime from Expires response header • Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) • Compute current age from Age response header • Compute current age from Date header • Revalidate stale responses based on Last-Modified response header • move buffer pointing to start of file before computing checksum. refs #92 (commit 6a5bef2) • Compute image checksum before persisting images. closes #92 (commit 9817df1) • remove leaking references0 码力 | 222 页 | 988.92 KB | 1 年前3
- Scrapy 0.22 Documentationdirective is set even for fresh responses Compute freshness lifetime from max-age cache-control directive Compute freshness lifetime from Expires response header Compute freshness lifetime from Last-Modified Last-Modified response header (heuristic used by Firefox) Compute current age from Age response header Compute current age from Date header Revalidate stale responses based on Last-Modified response header Revalidate computing checksum. refs #92 (commit 6a5bef2 [https://github.com/scrapy/scrapy/commit/6a5bef2]) Compute image checksum before persisting images. closes #92 (commit 9817df1 [https://github.com/scrapy/s0 码力 | 303 页 | 566.66 KB | 1 年前3
共 56 条
- 1
- 2
- 3
- 4
- 5
- 6