tai42-storage-s3
An S3 Storage backend for the TAI ecosystem. It stores text, binary, and media
content in an S3 bucket, implementing the full tai42_contract.storage.Storage
surface — the five text methods (load / list / upload / delete /
delete_dir) plus the binary/media methods (load_bytes / upload_bytes /
stat). S3 stores bytes natively, so the binary methods are true reads/writes
rather than the text bridge.
The TAI ecosystem
TAI is an open-source runtime for MCP tools, agents, and workflows. A Storage
backend is "where content physically lives" — a pluggable provider the runtime's
ResourceManager loads and renders content over. This package is one such
provider (S3); siblings back the same contract with GitHub or the local
filesystem. The ecosystem is open-ended: any package can back the same contract,
so this repo is this provider's own full doc home, and the documentation site
covers the platform-level story:
- Storage & resources concept: https://tai42.ai/concepts/storage-and-resources
- Build a storage provider (author guide): https://tai42.ai/guides/authors/storage-provider
- Ecosystem catalog: https://tai42.ai/reference/catalog
Its only tai-* dependencies are tai42-contract (the Storage ABC, ObjectStat,
assert_not_root, and the tai42_app handle) and tai42-kit (PooledClient,
TaiBaseSettings, and the settings cache). Beyond those it depends on its S3
driver (aioboto3, botocore) and pydantic / pydantic-settings.
Install
Requires Python 3.13+. Install from PyPI into the environment that runs the server:
uv add tai42-storage-s3
Or from source — clone this repo and add it as an editable dependency; the
tai42-* dependencies resolve in-tree from the workspace.
git clone https://github.com/tai42ai/tai42 # next to your app checkout
cd /path/to/your/app
uv add --editable ../tai42/plugins/storage-s3
Discovery
The skeleton discovers this backend by importing its package — importing
tai42_storage_s3 fires the @tai42_app.storage.register_storage decorator on
S3Storage as a side-effect (there is no entry-point). Name the package in your
manifest's storage_module field so the runtime imports it at startup:
storage_module: tai42_storage_s3
Configuration
Settings are read from the STORAGE_S3_ environment group (see
S3Settings):
| Env var | Default | Purpose |
|---|---|---|
STORAGE_S3_BUCKET |
— | Target bucket (required) |
STORAGE_S3_ENDPOINT |
— | Custom endpoint (e.g. MinIO); scheme inferred from SECURE if omitted |
STORAGE_S3_ACCESS_KEY |
— | AWS access key id |
STORAGE_S3_SECRET_KEY |
— | AWS secret access key |
STORAGE_S3_SECURE |
true |
Use HTTPS |
STORAGE_S3_REGION |
us-east-1 |
AWS region |
STORAGE_S3_VERIFY_SSL |
true |
Verify TLS certificates |
STORAGE_S3_CONNECT_TIMEOUT |
5 |
Connect timeout (seconds) |
STORAGE_S3_READ_TIMEOUT |
30 |
Read timeout (seconds) |
STORAGE_S3_ADDRESSING_STYLE |
auto |
path / virtual / auto |
STORAGE_S3_REQUEST_CHECKSUM_CALCULATION |
— | when_supported / when_required |
Content-type behavior
upload(text) storesContentType: application/jinja2— a template reads back as its authoring format, not an inferredtext/*.upload_bytesstores the parametrizedcontent_typeas the object'sContentType(omitted whenNone).statreturns the object's storedContentTypeviahead_object, mapping a missing object (404) toFileNotFoundError— no rawClientErroror metadata leaks. Because text uploads storeapplication/jinja2,staton a text template reports that type; it reads as non-media, which is the only thing the content-type gates.
Development
uv venv --python 3.13
uv pip install --no-sources --group dev --editable .
uv run --no-sync pytest --cov --cov-report=term-missing
uv run --no-sync ruff check .
uv run --no-sync ruff format --check .
uv run --no-sync pyright
License
Apache-2.0. See LICENSE and NOTICE.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file tai42_storage_s3-0.2.4.tar.gz.
File metadata
- Download URL: tai42_storage_s3-0.2.4.tar.gz
- Upload date:
- Size: 21.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0fe0f878d2a99b408c3c64e457c4804927acb69faa4db12a4ab204954b5271cc
|
|
| MD5 |
973a2c66ceba973723e1c9030c15edcc
|
|
| BLAKE2b-256 |
838de463aa6e5ac56ffe22ca797512ae46c56c169bc78d9f478efc6e7934bbe0
|
File details
Details for the file tai42_storage_s3-0.2.4-py3-none-any.whl.
File metadata
- Download URL: tai42_storage_s3-0.2.4-py3-none-any.whl
- Upload date:
- Size: 12.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4cfd4c8eff385ff1b4da02d40471f8624b47152ce5811be576ba309e15f0513f
|
|
| MD5 |
98da0cb9c1e42cb54204e4417249a46c
|
|
| BLAKE2b-256 |
9bb2ff3a3c056761bf9618a0c1cc78b29ca7ef5f351704cb2ba3b730bfc8f1a4
|