Memcached HTTP cache storage backend for Scrapy
Project description
Scrapy Memcached Cache
Memcached HTTP cache storage backend for Scrapy.
Install
Install the package with pipenv install scrapy-memcached-cache or pip install memcached-cache.
Usage
In your Scrapy settings.py:
Enable HTTP cache with HTTPCACHE_ENABLED = True
Set the cache expiration (in seconds), for example, with HTTPCACHE_EXPIRATION_SECS = 600
Set MemcachedCacheStorage as your cache storage with HTTPCACHE_STORAGE = 'scrapy_memcached_cache.MemcachedCacheStorage'
Set the location where your Memcached is running, for example, with MEMCACHED_LOCATION=localhost:11211
Done 🎉
Contributing
Please, format your code with Black.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Close
Hashes for scrapy-memcached-cache-0.0.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbc8b3649fde268b046e85bbcfbf475563a95b166be30612181a5443d68feec5 |
|
MD5 | d340477cf1d9bb2cabbb26ee3124fd98 |
|
BLAKE2b-256 | 3e807204d665aae9b3fb6fb997ff89b6009a52655e1e4101cf54df9dbdee76d3 |