Skip to main content

Unified filesystem abstraction for cloud storage — mount S3, GCS, and local storage with two lines of Python

Project description

nexus-fs

Unified filesystem abstraction for cloud storage. Mount S3, GCS, Google Workspace, and local storage with two lines of Python.

import nexus.fs

fs = nexus.fs.mount_sync("s3://my-bucket", "local://./data")
content = fs.read("/s3/my-bucket/README.md")

Install

pip install nexus-fs            # core (local only)
pip install nexus-fs[s3]        # + Amazon S3
pip install nexus-fs[gcs]       # + Google Cloud Storage
pip install nexus-fs[gdrive]    # + Google Drive
pip install nexus-fs[fsspec]    # + fsspec/pandas/dask integration
pip install nexus-fs[tui]       # + interactive TUI playground
pip install nexus-fs[all]       # everything

Quick Start

Async

import asyncio
import nexus.fs

async def main():
    fs = await nexus.fs.mount("s3://my-bucket", "local://./data")
    await fs.write("/local/data/hello.txt", b"Hello!")
    content = await fs.read("/local/data/hello.txt")
    print(content)

asyncio.run(main())

Sync

import nexus.fs

fs = nexus.fs.mount_sync("local://./data")
fs.write("/local/data/hello.txt", b"Hello!")
print(fs.read("/local/data/hello.txt"))

Connectors (Google Workspace, GitHub, Slack, etc.)

import nexus.fs

fs = nexus.fs.mount_sync("gws://sheets", "gws://docs")
# Uses gws CLI under the hood — no server needed

Prerequisite: gws:// mounts require the gws CLI to be installed and authenticated. Other connectors (GitHub, Slack) require OAuth credentials configured via environment variables — see nexus-fs doctor for diagnostics.

API

Method Description
read(path) Read file content
write(path, content) Write/overwrite file
ls(path, detail, recursive) List directory
stat(path) Get file metadata
exists(path) Check if path exists
delete(path) Delete a file
rename(old, new) Rename/move
copy(src, dst) Copy a file
mkdir(path) Create directory
list_mounts() List mount points

TUI Playground

pip install nexus-fs[tui]
nexus-fs playground s3://my-bucket local://./data

CLI

nexus-fs mount s3://my-bucket
nexus-fs mount list
nexus-fs mount test s3://my-bucket
nexus-fs unmount s3://my-bucket

Note: The TUI uses direct backend access for low-latency browsing. File operation semantics in the playground may differ from the library API (e.g., metadata fields, error messages). The library API (mount() / mount_sync()) is the authoritative interface. TUI/library unification is planned for a future release.

State Directory

nexus-fs stores runtime state (metadata DB, mount config) in a platform-specific directory. This state is a cache — it can be safely deleted and will be recreated on the next mount() call.

Platform Default path
Linux ~/.local/state/nexus-fs/
macOS ~/Library/Application Support/nexus-fs/
Windows %LOCALAPPDATA%/nexus-fs/

Override with the NEXUS_FS_STATE_DIR environment variable.

Persistent secrets (OAuth tokens, encryption keys) are stored separately under ~/.nexus/ with restricted permissions (0700). Override with NEXUS_FS_PERSISTENT_DIR.

Concurrency: nexus-fs is designed for single-process use per state directory. To run multiple independent instances, set a different NEXUS_FS_STATE_DIR for each process.

Relationship to nexus-ai-fs

nexus-fs is the slim standalone cloud storage package (~16 dependencies). nexus-ai-fs is the full Nexus filesystem/context plane (~100+ dependencies) that includes server, bricks, gRPC, federation, and more.

Both packages install into the nexus Python namespace. Do not install both in the same environment — they will conflict. Choose one:

  • pip install nexus-fs — lightweight cloud storage only
  • pip install nexus-ai-fs — full Nexus system (includes all nexus-fs functionality)

License

Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nexus_fs-0.4.6.tar.gz (2.5 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nexus_fs-0.4.6-py3-none-any.whl (3.2 MB view details)

Uploaded Python 3

File details

Details for the file nexus_fs-0.4.6.tar.gz.

File metadata

  • Download URL: nexus_fs-0.4.6.tar.gz
  • Upload date:
  • Size: 2.5 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for nexus_fs-0.4.6.tar.gz
Algorithm Hash digest
SHA256 39b455cf77954b7dcb2c9b58fa9467486aee7412f1b9055930396cc2e7b1a055
MD5 ce62eb836000c52360021a88852f8125
BLAKE2b-256 9c7ff552e7937cd87070de6ac012fa11f7dceb14c0b70b294d7f21f7aa02f3cf

See more details on using hashes here.

File details

Details for the file nexus_fs-0.4.6-py3-none-any.whl.

File metadata

  • Download URL: nexus_fs-0.4.6-py3-none-any.whl
  • Upload date:
  • Size: 3.2 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for nexus_fs-0.4.6-py3-none-any.whl
Algorithm Hash digest
SHA256 4848494b3bb736dbaf9ae33f4e06ec63d6148206b6187e141efd8d381d9bb56c
MD5 d7127012fa7fef57f4a92bcd1575e6f9
BLAKE2b-256 4fd6f02a968f6399f07eff43786a74c895f55a127eaa1927d0b9e2e6a5dff4bf

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page