💾 warc-s3

Scalable and easy WARC records storage on S3.

Installation

Install the package from PyPI:

pip install warc-s3

Usage

TODO

Development

To build this package and contribute to its development you need to install the build, and setuptools and wheel packages:

pip install build setuptools wheel

(On most systems, these packages are already pre-installed.)

Then, install the package and test dependencies:

pip install -e .[tests]

You can now verify your changes against the test suite.

ruff check .                   # Code format and LINT
mypy .                         # Static typing
bandit -c pyproject.toml -r .  # Security
pytest .                       # Unit tests

Please also add tests for your newly developed code.

Build wheels

Wheels for this package can be built with:

python -m build

Support

If you hit any problems using this package, please file an issue. We're happy to help!

License

This repository is released under the MIT license.

Metadata

Release files for warc-s3 1.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for warc-s3 1.0.1
File	Size	Uploaded
warc_s3-1.0.1.tar.gz	8.5 kB	Feb 27, 2025	Details

Built distribution (wheel)

Table of built distributions (wheels) for warc-s3 1.0.1
File	Interpreter	ABI	Platform	Reset
warc_s3-1.0.1-py3-none-any.whl 5.8 kB Feb 27, 2025	Python 3	none	any	Details

Total release size: 14.3 kB

Release files / warc_s3-1.0.1.tar.gz

Download URL	warc_s3-1.0.1.tar.gz
Size	8.5 kB
Tags	Source
SHA-256 checksum How to use checksums	`fb18ac5d1faa8d7baaf33c536cc4a81e08de55420f7440fe0f9cd9e74bb98978`
BLAKE2b-256 checksum How to use checksums	`7d4b5181cd00db22bb7ab885733b379c78e8f12665478e1b95f446310769b4e1`
Upload date	Feb 27, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.12.9`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/janheinrichmerker/warc-s3
Publishing commit: github.com/janheinrichmerker/warc-s3/tree/76d3df4407d8ef4f51d3146d36fd6bbb693e9f34

Workflow

Publishing configuration: github.com/janheinrichmerker/warc-s3/blob/76d3df4407d8ef4f51d3146d36fd6bbb693e9f34/.github/workflows/ci.yml
Publishing logs: github.com/janheinrichmerker/warc-s3/actions/runs/13571722304/attempts/1

Artifact

Subject: warc_s3-1.0.1.tar.gz
SHA-256 checksum: fb18ac5d1faa8d7baaf33c536cc4a81e08de55420f7440fe0f9cd9e74bb98978 Verifying attestations

Release files / warc_s3-1.0.1-py3-none-any.whl

Download URL	warc_s3-1.0.1-py3-none-any.whl
Size	5.8 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`cd94788f604a8330488620e831ac6597c8a768a4a5afe1d1d61a5a6374a5b78d`
BLAKE2b-256 checksum How to use checksums	`901dddeef6ab8da054a9182c832757c29c61e80d79807ed0a06eab42f7fd5981`
Upload date	Feb 27, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.12.9`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/janheinrichmerker/warc-s3
Publishing commit: github.com/janheinrichmerker/warc-s3/tree/76d3df4407d8ef4f51d3146d36fd6bbb693e9f34

Workflow

Publishing configuration: github.com/janheinrichmerker/warc-s3/blob/76d3df4407d8ef4f51d3146d36fd6bbb693e9f34/.github/workflows/ci.yml
Publishing logs: github.com/janheinrichmerker/warc-s3/actions/runs/13571722304/attempts/1

Artifact

Subject: warc_s3-1.0.1-py3-none-any.whl
SHA-256 checksum: cd94788f604a8330488620e831ac6597c8a768a4a5afe1d1d61a5a6374a5b78d Verifying attestations