S3 Content-Addressable Storage
Project description
S3 Content-Addressable Storage
Store files in S3 indexed by their SHA256 hash instead of by filename.
$ echo 'Hello World!' > foo
$ cp foo foo2
$ cat test.py
import s3_cas
c = s3_cas.S3CasClient("my-bucket", "blobs")
c.upload_file("foo")
c.upload_file("foo2")
$ python test.py
INFO:s3cas:Uploaded file to s3://my-bucket/blobs/03ba204e50d126e4674c005e04d82e84c21366780af1f43bd54a37816b6ab340
INFO:s3cas:File already exists with hash 03ba204e50d126e4674c005e04d82e84c21366780af1f43bd54a37816b6ab340, name foo, not uploading.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
s3-cas-1.0.0.tar.gz
(3.6 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file s3-cas-1.0.0.tar.gz.
File metadata
- Download URL: s3-cas-1.0.0.tar.gz
- Upload date:
- Size: 3.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d02e89a002a47798037f4e92a2b450d320242587c90b04c19f4f76e8ff597148
|
|
| MD5 |
7e92c8b18dc2f5fce6628d19af6f841d
|
|
| BLAKE2b-256 |
b61620297d078384a98a9284df8b6ca6e9c7f953372d6265fb829d1556bbd415
|
File details
Details for the file s3_cas-1.0.0-py2.py3-none-any.whl.
File metadata
- Download URL: s3_cas-1.0.0-py2.py3-none-any.whl
- Upload date:
- Size: 3.8 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.6.1 pkginfo/1.7.1 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.8.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3d21cefbf181172ca3843f2fc02e17cd990dbb3f76046a5dd3fe3ecbf7a9b9ed
|
|
| MD5 |
e460fecfc5c8ccfb52ef6d7d1655faca
|
|
| BLAKE2b-256 |
3947104237c0c2c92e75e57fa4d4c1adec367a7afc6898c990e3d2793ce8b70c
|
