Skip to main content

Some predefined web crawlers

Project description

Python3

A python library contains some predefined web crawlers. Attention: this package probably can’t work properly because of the correlated webs updates. If this situation happens, just fix it on your own.

Installation

pip install RunSpiders

Examples

novel

Please install calibre and add ebook-convert to environment variables.

from RunSpiders import NovelSpider

spider = NovelSpider()
spider.download_books(['***', ...])
# spider.download_books(['***', ...], style="recipe_first")

movie

Please install ffmpeg and add it to environment variables.

from RunSpiders import M3U8Spider

spider = M3U8Spider(output="F\movies")
spider.download_movies([(m3u8_url, file_name), ...])

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

RunSpiders-1.0.2.tar.gz (11.7 kB view hashes)

Uploaded Source

Built Distribution

RunSpiders-1.0.2-py2.py3-none-any.whl (16.3 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page