Memcached HTTP cache storage backend for Scrapy
Project description
Scrapy Memcached Cache
Memcached HTTP cache storage backend for Scrapy.
Install
Install the package with pipenv install scrapy-memcached-cache or pip install memcached-cache.
Usage
In your Scrapy settings.py:
Enable cache HTTPCACHE_ENABLED = True
Set the cache expiration (in seconds), for example, with HTTPCACHE_EXPIRATION_SECS = 600
Set MemcachedCacheStorage as your cache storage with HTTPCACHE_STORAGE = 'scrapy_memcached_cache.MemcachedCacheStorage'
Set the location where your Memcached is running, for example, eith MEMCACHED_LOCATION=localhost:11211
Done 🎉
Contributing
Please, format your code with Black.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Close
Hashes for scrapy-memcached-cache-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e802e47c12352b648c0853a7ccd103f515631084441e15e6c2e1a457b2f5131 |
|
MD5 | 190ec129998196a4a91ae6c4826d8f3c |
|
BLAKE2b-256 | 3536dec621395c2aea5b6e314f38614d27a749dfb7f08a1efb37bbde8cdc99cb |