Skip to main content

ZeroCrawler

从零开始写爬虫

安装

从 pypi 安装:

$ pip install ZeroCrawler

源码安装:

$ git clone git@github.com:MeiK2333/ZeroCrawler.git
$ cd ZeroCrawler/
$ pip install .

直接从 GitHub 安装:

$ git install git+https://github.com/MeiK2333/ZeroCrawler.git

使用

>>> from ZeroCrawler import get
>>> resp = get('http://httpbin.org/get')
>>> resp
<Response [200]>
>>> resp.content
'{\n  "args": {}, \n  "headers": {\n    "Host": "httpbin.org"\n  }, \n  "origin": "36.110.78.251, 36.110.78.251", \n  "url": "https://httpbin.org/get"\n}\n'
>>> resp = get('http://httpbin.org/status/404')
>>> resp
<Response [404]>

测试

$ python -m unittest tests/test_*.py

Metadata

Release files for ZeroCrawler 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ZeroCrawler 0.1.0
File Size Uploaded Provenance Actions
ZeroCrawler-0.1.0.tar.gz 3.0 kB Without provenance Details for ZeroCrawler-0.1.0.tar.gz

Release files / ZeroCrawler-0.1.0.tar.gz

Download URL ZeroCrawler-0.1.0.tar.gz
Size 3.0 kB
Tags Source
SHA-256 checksum
How to use checksums
4ad6b733f9b1858c659fe0c069ef6e59ae83bdd2efb03871ea984fca0741fe55
BLAKE2b-256 checksum
How to use checksums
0e891aff1f01d88eae04a6fb209c0066cc16c2593673073db6e21f52b9ee12dd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.6.8

Security for ZeroCrawler 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page