ruia_cache - A Ruia plugin for caching URL.
Project description
ruia-cache
A Ruia plugin for caching URL
Installation
pip install -U ruia-cache
# New features
pip install git+https://github.com/python-ruia/ruia-cache
Usage
ruia-cache
will automatically cache the captured URL to prevent the second request to the target web page:
import os
from ruia_cache import RuiaCacheSpider
# Set RUIA_CACHE path
os.environ.setdefault(
"RUIA_CACHE", os.path.dirname(__file__),
)
class Demo(RuiaCacheSpider):
name = "demo_spider"
start_urls = ["http://httpbin.org/get"]
async def parse(self, response):
html = await response.text()
print(html)
if __name__ == "__main__":
Demo.start()
# Using cache data
Demo.start()
Enjoy it :)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ruia_cache-0.0.2.tar.gz
(4.8 kB
view hashes)
Built Distribution
ruia_cache-0.0.2-py3-none-any.whl
(11.6 kB
view hashes)
Close
Hashes for ruia_cache-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f567db1b5f32844a3ae41b655a743009ae7b47edcc428b3a149d37d5c6696d4d |
|
MD5 | 626dc141168c5946b6b293d6a7278ba8 |
|
BLAKE2b-256 | 13337907855b553614c1442e695f940d0f5a22e382de03bb06521be35bbf62be |