netnovelcrawler

爬取小说网站并生成TXT

目前支持

安装

用法

CLI

config = (
    r'D:\net_novels\crawler_ocr\lord',
    {
        'start_page': 'https://ccc.xxxx.com/Novel/xxxxxx/',
        'login_info': ('test_login', 'test_pwd'),
        'image_folder': 'vip_images',
        'image_process': 'ocr',
        'text_file': 'xxx.txt',
    }
)
from netnovelcrawler import Crawler
from netnovelcrawler.utils.starter_stopper import AfterChapterStarter, CountStopper

mycrawler = Crawler(*config)
mycrawler.crawl(starter=AfterChapterStarter("10. 某章节"), stopper=CountStopper(50))

GUI

python -m netnovelcrawlertaskmgr

绕过滑块验证反爬虫机制

######修改chromedriver.exe

文本编辑器打开chromedriver.exe
找到cdc_字符串
等长替换$cdc_lasutopfhvcZLmcfl
保存

Metadata

Release files for netnovelcrawler 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for netnovelcrawler 0.0.2
File	Size	Uploaded	Provenance	Actions
netnovelcrawler-0.0.2.tar.gz	25.4 kB	Sep 16, 2024	Without provenance	Details for netnovelcrawler-0.0.2.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for netnovelcrawler 0.0.2
File	Interpreter	ABI	Platform	Actions Reset
netnovelcrawler-0.0.2-py3-none-any.whl 26.2 kB Sep 16, 2024 Without provenance	Python 3	none	any	Details for netnovelcrawler-0.0.2-py3-none-any.whl

Total release size: 51.6 kB

Release files / netnovelcrawler-0.0.2.tar.gz

Download URL	netnovelcrawler-0.0.2.tar.gz
Size	25.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`4264c6c68a8ff46aaed21f97881f988dde6bd392e7fd05ccd77fa51e7d90dd18`
BLAKE2b-256 checksum How to use checksums	`8e59e22840195f7f24d51fb0c8a501d94385218e84eadd3efeda008e5f7859cb`
Upload date	Sep 16, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Release files / netnovelcrawler-0.0.2-py3-none-any.whl

Download URL	netnovelcrawler-0.0.2-py3-none-any.whl
Size	26.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`13e8f51512a33c739366b502caa3c17d752e6e48bd12e8f20defee2a600eb811`
BLAKE2b-256 checksum How to use checksums	`dce722e1501b93433511075322f2c34e02cecb5aeaa31028f99a7cee677024be`
Upload date	Sep 16, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/4.0.2 CPython/3.9.16`

Security for netnovelcrawler 0.0.2

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.0.2 This release

Sep 16, 2024 2 release files No provenance

netnovelcrawler 0.0.2