A distributed spider framework

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for MindLullaby from gravatar.com MindLullaby

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: MindLullaby
  • Requires: Python >=3.10
Classifiers
Report project as malware

Project description

SpiderSwarm

SpiderSwarm 是一个分布式爬虫框架，提供高效的网络爬虫解决方案。

特性

  • 分布式架构
  • 高性能
  • 易扩展
  • 配置灵活

安装

pip install spiderswarm

快速开始

from spiderswarm import Spider

# 创建爬虫实例
spider = Spider()

# 配置爬虫
spider.configure(...)

# 启动爬虫
spider.run()

文档

详细文档请访问 项目文档

许可证

本项目采用 MIT 许可证 - 查看 LICENSE 文件了解详情。

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for MindLullaby from gravatar.com MindLullaby

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License
  • Author: MindLullaby
  • Requires: Python >=3.10
Classifiers

Release history Release notifications | RSS feed

This version

0.1.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bald_spider-0.1.1.tar.gz (25.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

bald_spider-0.1.1-py3-none-any.whl (39.1 kB view details)

Uploaded Python 3

File details

Details for the file bald_spider-0.1.1.tar.gz.

File metadata

  • Download URL: bald_spider-0.1.1.tar.gz
  • Upload date:
  • Size: 25.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for bald_spider-0.1.1.tar.gz
Algorithm Hash digest
SHA256 bfc9755a8ee6d84dfae024e850c2f522e210f9c926e853998fcea76e66316d1f
MD5 0e1e0f24cf6f5bc1733bcbbe9d6b3417
BLAKE2b-256 ae90ed75e2e228ff3e442e5b53841e304ac7de02a3141010786753e301379ba9

See more details on using hashes here.

File details

Details for the file bald_spider-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: bald_spider-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 39.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.16

File hashes

Hashes for bald_spider-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1ae8f625c5133f9daa2421c8738b197a7a30d522d20a6c892ac6a7d6034e42f7
MD5 d22bbbe24adcfb9d79b66aadf1dbcd71
BLAKE2b-256 419b376bd41a9435224c6785f7f8fadc4aca239fc415f84ddfdbef1403b537b7

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page