Skip to main content

Edge Studio — on-device LLM optimization workbench for Apple Silicon

Project description

Edge Studio

Edge Studio is AtomGradient's local workbench for building and testing on-device AI products on Apple Silicon. It ships as a Python package with a local Studio UI, an API server, and CLI workflows for model preparation, local chat, and the Neural Imprint learning demo.

Start with the developer documentation when you are building an app or integrating the SDK:

Install

Use Python 3.11 in an isolated environment before installing Edge Studio.

With venv:

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install edge-studio

With uv:

uv venv --python 3.11 .venv
source .venv/bin/activate
uv pip install edge-studio

Current release candidate: 0.0.1rc6.

For a deterministic RC install:

python -m pip install edge-studio==0.0.1rc6

The package installs one command-line entry point:

Command Use
edge Launch Studio, prepare models, run local chat, inspect receipts, and try the learning demo.

Quick Start

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install edge-studio
edge studio
open http://127.0.0.1:18842

Edge Studio binds to 127.0.0.1:18842 by default. Override the host or port with VLM_HOST and VLM_PORT when you need a different local address.

First Model

The baseline developer-preview model is qwen3.5-9b-4bit.

edge models where qwen3.5-9b-4bit
edge models fetch qwen3.5-9b-4bit --source auto

edge models fetch supports ModelScope, Hugging Face, and hf-mirror sources. The auto mode chooses a source order from the local network environment.

First Chat

Run a local multi-turn chat after the model is available:

edge demo chat --model qwen3.5-9b-4bit --interactive

The first 9B model load can take tens of seconds. After [chat:ready], ask a few questions and the answer streams token by token. The CLI uses model-aware generation defaults; override the output length with --max-tokens when needed. Exit with /exit.

Learning Demo

Run the local correction-learning demo once the baseline model is ready:

edge demo learn run --model qwen3.5-9b-4bit

The demo exercises local receipts, correction capture, Neural Imprint artifact generation, and a follow-up query without bundling internal evaluation data.

For the full walkthrough, SDK integration paths, and API references, use the Edge Developers documentation:

Source Install

Use the source path when contributing to Edge Studio or testing a local checkout:

git clone https://github.com/AtomGradient/edge-studio.git
cd edge-studio
python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install -e ".[dev]"

Launch the packaged UI/API server from the source checkout:

edge studio
open http://127.0.0.1:18842

For frontend development, run Vite separately and keep the backend server running:

npm --prefix frontend ci
npm --prefix frontend run dev
edge studio

The Vite UI runs at http://localhost:5173; the backend stays on http://127.0.0.1:18842.

Build a Wheel

python -m pip install --upgrade build
./scripts/build_wheel.sh

The build script compiles the frontend and copies frontend/dist into package resources before building the wheel, so users installing the wheel do not need Node.js.

Release Checks

python -m pytest tests -q
npm --prefix frontend run lint
npm --prefix frontend run build
python -m build

License

Edge Studio is released under the MIT License. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

edge_studio-0.0.1rc6.tar.gz (3.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

edge_studio-0.0.1rc6-py3-none-any.whl (4.0 MB view details)

Uploaded Python 3

File details

Details for the file edge_studio-0.0.1rc6.tar.gz.

File metadata

  • Download URL: edge_studio-0.0.1rc6.tar.gz
  • Upload date:
  • Size: 3.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc6.tar.gz
Algorithm Hash digest
SHA256 70c1b3f2e77527043ac451385273f7809e7a23d11a307d7fe0d20b69f67e218b
MD5 f65eea953e7c10cd955aa6d2ed0e61ce
BLAKE2b-256 b42bc769fab9e42b2abfacb0fda470927749d25dc6a08679dd6998e343f9f10f

See more details on using hashes here.

File details

Details for the file edge_studio-0.0.1rc6-py3-none-any.whl.

File metadata

  • Download URL: edge_studio-0.0.1rc6-py3-none-any.whl
  • Upload date:
  • Size: 4.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc6-py3-none-any.whl
Algorithm Hash digest
SHA256 fe3cf0f414779e8cb1ab7b9c677d781c444ae078e0e1da342241654a0e5c1d7d
MD5 6f6babe11e7e5d3629321bec6417e1d6
BLAKE2b-256 1ce064ae0a4d7d2bce1097744d39766f796b1175ff6113b4417de3b83a2ffc86

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page