A distributed spider framework

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for MindLullaby from gravatar.com MindLullaby

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Your Name
  • Requires: Python >=3.6
Classifiers
Report project as malware

Project description

SpiderSwarm

SpiderSwarm 是一个分布式爬虫框架，提供高效的网络爬虫解决方案。

特性

  • 分布式架构
  • 高性能
  • 易扩展
  • 配置灵活

安装

pip install spiderswarm

快速开始

from spiderswarm import Spider

# 创建爬虫实例
spider = Spider()

# 配置爬虫
spider.configure(...)

# 启动爬虫
spider.run()

文档

详细文档请访问 项目文档

许可证

本项目采用 MIT 许可证 - 查看 LICENSE 文件了解详情。

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for MindLullaby from gravatar.com MindLullaby

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: Your Name
  • Requires: Python >=3.6
Classifiers

Release history Release notifications | RSS feed

This version

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spiderswarm-0.1.0.tar.gz (28.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

spiderswarm-0.1.0-py3-none-any.whl (47.8 kB view details)

Uploaded Python 3

File details

Details for the file spiderswarm-0.1.0.tar.gz.

File metadata

  • Download URL: spiderswarm-0.1.0.tar.gz
  • Upload date:
  • Size: 28.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for spiderswarm-0.1.0.tar.gz
Algorithm Hash digest
SHA256 6700660651a7c4763bd47783ed8909a67027b87e7e9188c43e0be3a036067cc9
MD5 a0c5285b8e7ab60659fb6b76be5aaf39
BLAKE2b-256 cb6f86cea5d932b4c651ede6f64dbb0fb228fdf4d82f5cf4de4d072130af8f7a

See more details on using hashes here.

File details

Details for the file spiderswarm-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: spiderswarm-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 47.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for spiderswarm-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ae905fbb452f72f7dbb994fdcd3a003e07db1dec7159515c7e61183247d2861f
MD5 59649a3bb124e1a94d4141eaa3a55f5a
BLAKE2b-256 9f27eb029583a86a80cd7071e8ca75823729270f7577c0ef4a1ace1300f0280c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page