Skip to main content

S3 Content-Addressable Storage

Project description

S3 Content-Addressable Storage

Store files in S3 indexed by their SHA256 hash instead of by filename.

$ echo 'Hello World!' > foo
$ cp foo foo2
$ cat test.py
import s3_cas
c = s3_cas.S3CasClient("my-bucket", "blobs")
c.upload_file("foo")
c.upload_file("foo2")
$ python test.py
INFO:s3cas:Uploaded file to s3://my-bucket/blobs/03ba204e50d126e4674c005e04d82e84c21366780af1f43bd54a37816b6ab340
INFO:s3cas:File already exists with hash 03ba204e50d126e4674c005e04d82e84c21366780af1f43bd54a37816b6ab340, name foo, not uploading.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

s3-cas-1.0.0.tar.gz (3.6 kB view hashes)

Uploaded Source

Built Distribution

s3_cas-1.0.0-py2.py3-none-any.whl (3.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page