Skip to main content

Scalable and easy WARC records storage on S3.

Project description

PyPi CI Code coverage Python Issues Commit activity Downloads License

💾 warc-s3

Scalable and easy WARC records storage on S3.

Installation

Install the package from PyPI:

pip install warc-s3

Usage

TODO

Development

To build this package and contribute to its development you need to install the build, and setuptools and wheel packages:

pip install build setuptools wheel

(On most systems, these packages are already pre-installed.)

Then, install the package and test dependencies:

pip install -e .[tests]

You can now verify your changes against the test suite.

ruff check .                   # Code format and LINT
mypy .                         # Static typing
bandit -c pyproject.toml -r .  # Security
pytest .                       # Unit tests

Please also add tests for your newly developed code.

Build wheels

Wheels for this package can be built with:

python -m build

Support

If you hit any problems using this package, please file an issue. We're happy to help!

License

This repository is released under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

warc_s3-1.0.1.tar.gz (8.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

warc_s3-1.0.1-py3-none-any.whl (5.8 kB view details)

Uploaded Python 3

File details

Details for the file warc_s3-1.0.1.tar.gz.

File metadata

  • Download URL: warc_s3-1.0.1.tar.gz
  • Upload date:
  • Size: 8.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for warc_s3-1.0.1.tar.gz
Algorithm Hash digest
SHA256 fb18ac5d1faa8d7baaf33c536cc4a81e08de55420f7440fe0f9cd9e74bb98978
MD5 9c01103bc947c28c280d629be3a3dad0
BLAKE2b-256 7d4b5181cd00db22bb7ab885733b379c78e8f12665478e1b95f446310769b4e1

See more details on using hashes here.

Provenance

The following attestation bundles were made for warc_s3-1.0.1.tar.gz:

Publisher: ci.yml on janheinrichmerker/warc-s3

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file warc_s3-1.0.1-py3-none-any.whl.

File metadata

  • Download URL: warc_s3-1.0.1-py3-none-any.whl
  • Upload date:
  • Size: 5.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for warc_s3-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 cd94788f604a8330488620e831ac6597c8a768a4a5afe1d1d61a5a6374a5b78d
MD5 909475393a7a07b0b3aab2bc34de662f
BLAKE2b-256 901dddeef6ab8da054a9182c832757c29c61e80d79807ed0a06eab42f7fd5981

See more details on using hashes here.

Provenance

The following attestation bundles were made for warc_s3-1.0.1-py3-none-any.whl:

Publisher: ci.yml on janheinrichmerker/warc-s3

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page