Skip to main content

s3like

A small package that is used by COMP to read and write model results to S3 like object storage systems. This means that this package is compatible with DigitalOcean Spaces and AWS S3, since DO Spaces uses the same API as AWS S3.

Setup:

pip install s3like
export OBJ_STORAGE_ACCESS=...
export OBJ_STORAGE_SECRET=...
export OBJ_STORAGE_ENDPOINT=...
export OBJ_STORAGE_EDGE=...
export OBJ_STORAGE_BUCKET=...

Use:

import s3like

# run_model returns data that is compliant with the COMP outputs api.
local_result, task_id = run_model(**kwargs)
remote_result = s3like.write_to_s3like(task_id, local_result)
round_trip = s3like.read_from_s3like(remote_result)
assert local_result == round_trip

Test:

py.test -v

Release files for s3like 1.5.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for s3like 1.5.0
File Size Uploaded
s3like-1.5.0.tar.gz 3.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for s3like 1.5.0
File Interpreter ABI Platform
s3like-1.5.0-py3-none-any.whl Python 3 none any Details

Total release size: 8.2 kB

Release files / s3like-1.5.0.tar.gz

Download URL s3like-1.5.0.tar.gz
Size 3.7 kB
Tags Source
SHA-256 checksum
How to use checksums
cd96cba75c8ebabdfb338f6c1aa4a8bc566a7a0436b289235222926ee8509979
BLAKE2b-256 checksum
How to use checksums
c56bb7b19e3864b43e6bed5b23b1ccb644fe40de994957200a68b3b406211e39
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

Release files / s3like-1.5.0-py3-none-any.whl

Download URL s3like-1.5.0-py3-none-any.whl
Size 4.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9792a3629ad8a2305d8564fdcddd61d68a8c07883423fa08c78fb900084d902c
BLAKE2b-256 checksum
How to use checksums
d94875319bc2520d25692f78848f3aab743e5c7f4d528d7eb25fe9a40ffe63b9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.3

Release history Release notifications | RSS feed

This release

1.5.0 This release

2 release files

1.4.0

2 release files

1.3.1

2 release files

1.3.0

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page