Skip to main content

SpiderSwarm

SpiderSwarm 是一个分布式爬虫框架,提供高效的网络爬虫解决方案。

特性

  • 分布式架构
  • 高性能
  • 易扩展
  • 配置灵活

安装

pip install spiderswarm

快速开始

from spiderswarm import Spider

# 创建爬虫实例
spider = Spider()

# 配置爬虫
spider.configure(...)

# 启动爬虫
spider.run()

文档

详细文档请访问 项目文档

许可证

本项目采用 MIT 许可证 - 查看 LICENSE 文件了解详情。

Metadata

Release files for spiderswarm 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for spiderswarm 0.1.0
File Size Uploaded
spiderswarm-0.1.0.tar.gz 28.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for spiderswarm 0.1.0
File Interpreter ABI Platform
spiderswarm-0.1.0-py3-none-any.whl Python 3 none any Details

Total release size: 76.6 kB

Release files / spiderswarm-0.1.0.tar.gz

Download URL spiderswarm-0.1.0.tar.gz
Size 28.8 kB
Tags Source
SHA-256 checksum
How to use checksums
6700660651a7c4763bd47783ed8909a67027b87e7e9188c43e0be3a036067cc9
BLAKE2b-256 checksum
How to use checksums
cb6f86cea5d932b4c651ede6f64dbb0fb228fdf4d82f5cf4de4d072130af8f7a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.10.16

Release files / spiderswarm-0.1.0-py3-none-any.whl

Download URL spiderswarm-0.1.0-py3-none-any.whl
Size 47.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ae905fbb452f72f7dbb994fdcd3a003e07db1dec7159515c7e61183247d2861f
BLAKE2b-256 checksum
How to use checksums
9f27eb029583a86a80cd7071e8ca75823729270f7577c0ef4a1ace1300f0280c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.10.16

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page