Some predefined web crawlers
Project description
A python library contains some predefined web crawlers. Attention: this package probably can’t work properly because of the correlated webs updates. If this situation happens, just fix it on your own.
Installation
pip install RunSpiders
Examples
novel
Please install calibre and add ebook-convert to environment variables.
from RunSpiders import NovelSpider
spider = NovelSpider()
spider.download_books(['***', ...])
# spider.download_books(['***', ...], style="recipe_first")
movie
Please install ffmpeg and add it to environment variables.
from RunSpiders import M3U8Spider
spider = M3U8Spider(output="F\movies")
spider.download_movies([(m3u8_url, file_name), ...])
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
RunSpiders-1.0.5.tar.gz
(13.3 kB
view hashes)
Built Distribution
Close
Hashes for RunSpiders-1.0.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 739a584b4ea6d791a589cc8b3760ff5927827aaff15ee638f880842fb71e9667 |
|
MD5 | 79ee2038244ccda70a025fa3748ceb58 |
|
BLAKE2b-256 | 1cfba564b15128a16bf9720d20ddb9d71caf93d0b1579c70fc05608946e423f3 |