Skip to main content

SpiderSwarm

SpiderSwarm 是一个分布式爬虫框架,提供高效的网络爬虫解决方案。

特性

  • 分布式架构
  • 高性能
  • 易扩展
  • 配置灵活

安装

pip install spiderswarm

快速开始

from spiderswarm import Spider

# 创建爬虫实例
spider = Spider()

# 配置爬虫
spider.configure(...)

# 启动爬虫
spider.run()

文档

详细文档请访问 项目文档

许可证

本项目采用 MIT 许可证 - 查看 LICENSE 文件了解详情。

Metadata

Release files for bald-spider 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for bald-spider 0.1.1
File Size Uploaded
bald_spider-0.1.1.tar.gz 25.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for bald-spider 0.1.1
File Interpreter ABI Platform
bald_spider-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 64.1 kB

Release files / bald_spider-0.1.1.tar.gz

Download URL bald_spider-0.1.1.tar.gz
Size 25.0 kB
Tags Source
SHA-256 checksum
How to use checksums
bfc9755a8ee6d84dfae024e850c2f522e210f9c926e853998fcea76e66316d1f
BLAKE2b-256 checksum
How to use checksums
ae90ed75e2e228ff3e442e5b53841e304ac7de02a3141010786753e301379ba9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.10.16

Release files / bald_spider-0.1.1-py3-none-any.whl

Download URL bald_spider-0.1.1-py3-none-any.whl
Size 39.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
1ae8f625c5133f9daa2421c8738b197a7a30d522d20a6c892ac6a7d6034e42f7
BLAKE2b-256 checksum
How to use checksums
419b376bd41a9435224c6785f7f8fadc4aca239fc415f84ddfdbef1403b537b7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.10.16

Release history Release notifications | RSS feed

This release

0.1.1 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page