novel grab crawler module using python3 and lxml
Project description
novel grab crawler module using python3 and lxml
multiprocesssing with multithread version
winxos, AISTLAB Since 2017-02-19
INSTALL:
pip3 install aistlab_novel_grab
USAGE:
from novel_grab.novel_grab import Downloader
d = Downloader()
print(d.get_info())
if d.set_url('http://book.zongheng.com/showchapter/221579.html'):
d.start()
TIPS
When d = Downloader(), d.get_info() can get supported sites info.
Once d.set_url(url) will return the url is valid or not.
Of course you can use d.get_info() to access the state of d at any time.
While finished, will create \(novel_name\).zip file in your current path, default zip method using zipfile.ZIP_DEFLATED
Just for educational purpose, take care of yourself.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for AISTLAB_novel_grab-1.2.8-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1376707cc7e66d7484e8af2691de4c250f604dbc5ef30eff93a40885469eebff |
|
MD5 | 8f7af12c5bf4f5c8befb19bf4f435f78 |
|
BLAKE2b-256 | d0391508fd48c1b91e6a650eedb63df06d3c3b258d2a6ef2d134e1329db03456 |