A python library contains many predefined powerful web crawlers.
Attention: this package probably can’t work properly because of the correlated webs’ updates. If this situation happens, just fix it on your own.
Installation
pip install RunSpidersRequirements
from RunSpiders import Checker
checker = Checker()
checker.main()1. [calibre](https://calibre-ebook.com/download) for converting ebook [Mac安装Calibre电子书应用](https://blog.csdn.net/u012955829/article/details/99240602)
[MAC 系统安装FFmpeg](https://www.jianshu.com/p/73441acf7815)
Examples
novel
Please install calibre and add ebook-convert to environment variables.
from RunSpiders import WebFictionSpider
output = "F:/ebooks"
spider = WebFictionSpider(output)
s.download(book="诛仙")
s.download(author="云天空")
s.download_books(["秘巫之主", "极品家丁"])movie
Please install ffmpeg and add it to environment variables.
from RunSpiders.video.base.m3u8 import M3U8Spider
spider = M3U8Spider(output="F\movies")
spider.download_movies([(m3u8_url, file_name), ...])FAQ
IPython报错
问题：ImportError: cannot import name ‘generator_to_async_generator’
解决方案：pip install ipython prompt_toolkit --upgrade
1 maintainer
Metadata
1 maintainer
Release files for RunSpiders 1.0.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| RunSpiders-1.0.8.tar.gz | 24.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| RunSpiders-1.0.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 53.6 kB
Release files / RunSpiders-1.0.8.tar.gz
| Download URL | RunSpiders-1.0.8.tar.gz |
|---|---|
| Size | 24.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
78d227796ab8bb69d0c330577af9a5835a3d651cd2ff9150c44dd94f3a9a5067
|
|
BLAKE2b-256 checksum How to use checksums |
883fa2a3014fc37b194fcfffe30d338922eb94cd5053937bcc77c24abd093108
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.5
|
Release files / RunSpiders-1.0.8-py3-none-any.whl
| Download URL | RunSpiders-1.0.8-py3-none-any.whl |
|---|---|
| Size | 29.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8c93f89533f990fd2c78cd553453d46dae18087b7f1efc46ec110030e026e9b5
|
|
BLAKE2b-256 checksum How to use checksums |
86baa9a8608bd651e7381b20fa64cec993f40f843fe7fffa4ad98c3a8fd2601d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.8.5
|
