Scrapy Memcached Cache
Memcached HTTP cache storage backend for Scrapy.
Install
Install the package with pipenv install scrapy-memcached-cache or pip install memcached-cache.
Usage
In your Scrapy settings.py:
Enable HTTP cache with HTTPCACHE_ENABLED = True
Set the cache expiration (in seconds), for example, with HTTPCACHE_EXPIRATION_SECS = 600
Set MemcachedCacheStorage as your cache storage with HTTPCACHE_STORAGE = 'scrapy_memcached_cache.MemcachedCacheStorage'
Set the location where your Memcached is running, for example, with MEMCACHED_LOCATION=localhost:11211
Done 🎉
Contributing
Please, format your code with Black.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file scrapy-memcached-cache-0.0.3.tar.gz.
File metadata
- Download URL: scrapy-memcached-cache-0.0.3.tar.gz
- Upload date:
- Size: 2.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fbc8b3649fde268b046e85bbcfbf475563a95b166be30612181a5443d68feec5
|
|
| MD5 |
d340477cf1d9bb2cabbb26ee3124fd98
|
|
| BLAKE2b-256 |
3e807204d665aae9b3fb6fb997ff89b6009a52655e1e4101cf54df9dbdee76d3
|
