Skip to main content

storix

Storix

Storage for Unix lovers.

One unix-flavored filesystem API over any storage: local disk, in-memory,
Azure Data Lake. Python-first, sync and async, sandboxable, fully typed.

PyPI version GitHub stars License

Documentation: storix.mghalix.com


Storix puts one unix filesystem interface in front of every storage backend, so you work with cloud storage the way you already work with local files: ls, cd, cat, mkdir, mv, rm. The backend can be your disk, an in-memory store for tests, or Azure Data Lake in production, behind one small, fully typed API, sync or async. Swap the backend, keep the code.

It is not a plumbing competitor to the cloud SDKs. It is the ergonomic layer over them, the way FastAPI is a layer over the web rather than a new web server.

Install

uv add storix            # local filesystem + in-memory
uv add "storix[azure]"   # + Azure Data Lake Gen2 (HNS accounts)
uv add "storix[cli]"     # + the sx command-line interface
uv add "storix[all]"     # all optional features

Quick look

from storix import Storix
from storix.backends import LocalBackend

fs = Storix(LocalBackend('~/storix-data'))  # '/' is anchored at ~/storix-data

fs.mkdir('/docs')
fs.echo('hello, storix!', '/docs/readme.txt')
print(fs.cat('/docs/readme.txt'))       # b'hello, storix!'

fs.cd('/docs')                          # a session has a cwd, like a shell
fs.mkdir('/archive')
fs.mv('readme.txt', '/archive')         # the last argument is the destination

Async is the same API under storix.aio, generated from the sync source so the two never drift:

from storix.aio import get_storage

async with get_storage('azure') as fs:
    await fs.echo(b'...', '/report.csv')
    print(await fs.url('/report.csv', expires_in=600))   # presigned SAS link

Highlights

  • Unix semantics, everywhere. ls/cd/cat/du/mv with a real session and cwd, identical across local, memory, and cloud. The cli extra adds an sx shell too.
  • Python-first and streaming. echo takes bytes, str, an iterator, or an async iterator, so large files move through bounded memory instead of loading whole.
  • Composable layers. Sandbox a session (escape-proof chroot), add a read-through cache, or backfill capabilities, all as middleware that wraps any backend.
  • Sync and async, one API, generated from a single source and proven by one conformance suite across every backend.
  • Typed and safe. Fully typed and py.typed. Every failure raises a typed error, and a sandbox cannot be escaped, not even by the code inside it.

Full tutorials, task recipes (FastAPI, settings, caching, testing, custom backends), and the API reference live at storix.mghalix.com.

Backends

Backend Import Notes
Local disk storix.backends.LocalBackend anchored at a base directory
In-memory storix.backends.MemoryBackend reference backend, great for tests
Azure ADLS Gen2 storix.backends.AzureBackend requires hierarchical namespaces

Third-party backends implement the small StorageBackend port and register via register_backend(). See Write a custom backend.

Migrating from 0.1.x

0.2.0 was a ground-up rework (hexagonal core, generated sync flavor, layers, capabilities). See the migration table in release-notes.md.

License

Apache 2.0. See LICENSE.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

storix-0.3.0.tar.gz (86.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

storix-0.3.0-py3-none-any.whl (120.0 kB view details)

Uploaded Python 3

File details

Details for the file storix-0.3.0.tar.gz.

File metadata

  • Download URL: storix-0.3.0.tar.gz
  • Upload date:
  • Size: 86.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for storix-0.3.0.tar.gz
Algorithm Hash digest
SHA256 69f39ad903c51189ff9a923282f8d56d638b57853820c0cd6b45eea9c1161dfb
MD5 6c694f4844094d06c1c6f1f3bec8d596
BLAKE2b-256 c067e7d832edeb3cea40926dc6cab8ba44a7b431c2d2b7ccc9050644f81b6681

See more details on using hashes here.

File details

Details for the file storix-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: storix-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 120.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for storix-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 8c8276b2ac4e5074b9030b359bf0f6ce1d239bb55adb30142a539f351ba1b46d
MD5 c97b0633392221dac3c1d39940541d3d
BLAKE2b-256 e353d69ec9d1ec8a03390780bac2d6c7ed34da2ba2d1b6c083df8b4b3ff61bdf

See more details on using hashes here.

Release history Release notifications | RSS feed

0.5.5

2 files

0.5.4

2 files

0.5.3

2 files

0.5.2

2 files

0.5.1

2 files

0.5.0

2 files

0.4.9

2 files

0.4.8

2 files

0.4.7

2 files

0.4.6

2 files

0.4.5

2 files

0.4.4

2 files

0.4.3

2 files

0.4.2

2 files

0.4.1

2 files

0.4.0

2 files

This release

0.3.0 This release

2 files

0.2.2

2 files

0.2.1

2 files

0.2.0

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page