Skip to main content

Spider

Spider is the project-local concurrent HTTP downloader.

Entry points

Programmatic:

from tools.spider import Download, DownloadManager

CLI:

python -m tools.spider --help
python -m tools.spider -j 5 -c 10 -o downloads URL1 URL2

parallel limits active files; max_connections limits HTTP connections globally. Spare range connections are assigned using predicted ETA reduction and runtime per-domain throughput learning.

See docs/tools/spider/DOCS.md for complete documentation.

Directory contents

Files

  • __init__.py — Concurrent ETA-optimized HTTP downloader.
  • __main__.py — Run Spider from python -m tools.spider.
  • core.py — Parallel HTTP downloads with a fixed-height ANSI terminal dashboard.

Subdirectories

No subdirectories.

Metadata

Release files for arach 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for arach 0.1.0
File Size Uploaded Provenance Actions
arach-0.1.0.tar.gz 17.0 kB Without provenance Details for arach-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for arach 0.1.0
File Interpreter ABI Platform Actions
arach-0.1.0-py3-none-any.whl Python 3 none any Details for arach-0.1.0-py3-none-any.whl

Total release size: 34.7 kB

Release files / arach-0.1.0.tar.gz

Download URL arach-0.1.0.tar.gz
Size 17.0 kB
Tags Source
SHA-256 checksum
How to use checksums
6e437bbc5503cf7a3f5627f577d29b2210caade6a1fa9353fa084976898385fd
BLAKE2b-256 checksum
How to use checksums
1f06efbde1d0aaac3c64724cac13aebeb46f65a61d6ef4f4c4dbff1afb28cbeb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.9

Release files / arach-0.1.0-py3-none-any.whl

Download URL arach-0.1.0-py3-none-any.whl
Size 17.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5ccd5cb805cb361d6410d9a69fb389da41e5dbbb2370ec4e6aef8deb721699cc
BLAKE2b-256 checksum
How to use checksums
25a029fc7fc40b23791278582a2a49b2e28548a257562ea9f3ab59caaa4c2c48
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.9

Security for arach 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page