Skip to main content

Unified filesystem abstraction for cloud storage — mount S3, GCS, and local storage with two lines of Python

Project description

nexus-fs

Unified filesystem abstraction for cloud storage. Mount S3, GCS, Google Workspace, and local storage with two lines of Python.

import nexus.fs

fs = nexus.fs.mount_sync("s3://my-bucket", "local://./data")
content = fs.read("/s3/my-bucket/README.md")

Install

pip install nexus-fs            # core (local only)
pip install nexus-fs[s3]        # + Amazon S3
pip install nexus-fs[gcs]       # + Google Cloud Storage
pip install nexus-fs[gdrive]    # + Google Drive
pip install nexus-fs[fsspec]    # + fsspec/pandas/dask integration
pip install nexus-fs[tui]       # + interactive TUI playground
pip install nexus-fs[all]       # everything

Quick Start

Async

import asyncio
import nexus.fs

async def main():
    fs = await nexus.fs.mount("s3://my-bucket", "local://./data")
    await fs.write("/local/data/hello.txt", b"Hello!")
    content = await fs.read("/local/data/hello.txt")
    print(content)

asyncio.run(main())

Sync

import nexus.fs

fs = nexus.fs.mount_sync("local://./data")
fs.write("/local/data/hello.txt", b"Hello!")
print(fs.read("/local/data/hello.txt"))

Connectors (Google Workspace, GitHub, Slack, etc.)

import nexus.fs

fs = nexus.fs.mount_sync("gws://sheets", "gws://docs")
# Uses gws CLI under the hood — no server needed

Prerequisite: gws:// mounts require the gws CLI to be installed and authenticated. Other connectors (GitHub, Slack) require OAuth credentials configured via environment variables — see nexus-fs doctor for diagnostics.

API

Method Description
read(path) Read file content
write(path, content) Write/overwrite file
ls(path, detail, recursive) List directory
stat(path) Get file metadata
exists(path) Check if path exists
delete(path) Delete a file
rename(old, new) Rename/move
copy(src, dst) Copy a file
mkdir(path) Create directory
list_mounts() List mount points

TUI Playground

pip install nexus-fs[tui]
nexus-fs playground s3://my-bucket local://./data

CLI

nexus-fs mount s3://my-bucket
nexus-fs mount list
nexus-fs mount test s3://my-bucket
nexus-fs unmount s3://my-bucket

Note: The TUI uses direct backend access for low-latency browsing. File operation semantics in the playground may differ from the library API (e.g., metadata fields, error messages). The library API (mount() / mount_sync()) is the authoritative interface. TUI/library unification is planned for a future release.

State Directory

nexus-fs stores runtime state (metadata DB, mount config) in a platform-specific directory. This state is a cache — it can be safely deleted and will be recreated on the next mount() call.

Platform Default path
Linux ~/.local/state/nexus-fs/
macOS ~/Library/Application Support/nexus-fs/
Windows %LOCALAPPDATA%/nexus-fs/

Override with the NEXUS_FS_STATE_DIR environment variable.

Persistent secrets (OAuth tokens, encryption keys) are stored separately under ~/.nexus/ with restricted permissions (0700). Override with NEXUS_FS_PERSISTENT_DIR.

Concurrency: nexus-fs is designed for single-process use per state directory. To run multiple independent instances, set a different NEXUS_FS_STATE_DIR for each process.

Relationship to nexus-ai-fs

nexus-fs is the slim standalone cloud storage package (~16 dependencies). nexus-ai-fs is the full Nexus filesystem/context plane (~100+ dependencies) that includes server, bricks, gRPC, federation, and more.

Both packages install into the nexus Python namespace. Do not install both in the same environment — they will conflict. Choose one:

  • pip install nexus-fs — lightweight cloud storage only
  • pip install nexus-ai-fs — full Nexus system (includes all nexus-fs functionality)

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nexus_fs-0.4.8.tar.gz (2.7 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nexus_fs-0.4.8-py3-none-any.whl (3.5 MB view details)

Uploaded Python 3

File details

Details for the file nexus_fs-0.4.8.tar.gz.

File metadata

  • Download URL: nexus_fs-0.4.8.tar.gz
  • Upload date:
  • Size: 2.7 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for nexus_fs-0.4.8.tar.gz
Algorithm Hash digest
SHA256 d71213dd03145a569667d3a4fff2be78462e41a37506e9fe29239ba9ab0bd191
MD5 00915b6795ddc2389b02fe2bccd8fc8d
BLAKE2b-256 6cd689d695af0b80bbedd80b724cc927e6f349a1b7620cd2d12136974953a7e2

See more details on using hashes here.

File details

Details for the file nexus_fs-0.4.8-py3-none-any.whl.

File metadata

  • Download URL: nexus_fs-0.4.8-py3-none-any.whl
  • Upload date:
  • Size: 3.5 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for nexus_fs-0.4.8-py3-none-any.whl
Algorithm Hash digest
SHA256 ed0dd6b1331e2821c5e144bfd87ad59ad0192842d3619afe425eb78b774434c1
MD5 d200beca0dd006badf610acd2594d56a
BLAKE2b-256 cc69401975b88719b5a57bde7e7d7f975508d7bc353a1b8162e09dbbfdebf44c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page