A python library contains many powerful web crawlers.
Project description
A python library contains many predefined powerful web crawlers.
Attention: this package probably can’t work properly because of the correlated webs’ updates. If this situation happens, just fix it on your own.
Installation
pip install RunSpiders
Requirements
from RunSpiders import Checker
checker = Checker()
checker.main()
1. [calibre](https://calibre-ebook.com/download) for converting ebook [Mac安装Calibre电子书应用](https://blog.csdn.net/u012955829/article/details/99240602)
[MAC 系统安装FFmpeg](https://www.jianshu.com/p/73441acf7815)
Examples
novel
Please install calibre and add ebook-convert to environment variables.
from RunSpiders import WebFictionSpider
output = "F:/ebooks"
spider = WebFictionSpider(output)
s.download(book="诛仙")
s.download(author="云天空")
s.download_books(["秘巫之主", "极品家丁"])
movie
Please install ffmpeg and add it to environment variables.
from RunSpiders.video.base.m3u8 import M3U8Spider
spider = M3U8Spider(output="F\movies")
spider.download_movies([(m3u8_url, file_name), ...])
FAQ
IPython报错
问题:ImportError: cannot import name ‘generator_to_async_generator’
解决方案:pip install ipython prompt_toolkit --upgrade
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for RunSpiders-1.0.8-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c93f89533f990fd2c78cd553453d46dae18087b7f1efc46ec110030e026e9b5 |
|
MD5 | f128b5732640fcce2f4a468ef7935822 |
|
BLAKE2b-256 | 86baa9a8608bd651e7381b20fa64cec993f40f843fe7fffa4ad98c3a8fd2601d |