Skip to main content

Edge Studio — on-device LLM optimization workbench for Apple Silicon

Project description

Edge Studio

Edge Studio is AtomGradient's local workbench for building and testing on-device AI products on Apple Silicon. It ships as a Python package with a local Studio UI, an API server, and CLI workflows for model preparation, local chat, and the Neural Imprint learning demo.

Start with the developer documentation when you are building an app or integrating the SDK:

Install

Use Python 3.11 in an isolated environment before installing Edge Studio.

With venv:

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install edge-studio

With uv:

uv venv --python 3.11 .venv
source .venv/bin/activate
uv pip install edge-studio

Current release candidate: 0.0.1rc8.

For a deterministic RC install:

python -m pip install edge-studio==0.0.1rc8

The package installs one command-line entry point:

Command Use
edge Launch Studio, prepare models, run local chat, inspect receipts, and try the learning demo.

Quick Start

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install edge-studio
edge studio
open http://127.0.0.1:18842

Edge Studio binds to 127.0.0.1:18842 by default. Override the host or port with VLM_HOST and VLM_PORT when you need a different local address.

First Model

The baseline developer-preview model is qwen3.5-9b-4bit.

edge models where qwen3.5-9b-4bit
edge models fetch qwen3.5-9b-4bit --source auto

edge models fetch supports ModelScope, Hugging Face, and hf-mirror sources. The auto mode chooses a source order from the local network environment.

First Chat

Run a local multi-turn chat after the model is available:

edge demo chat --model qwen3.5-9b-4bit --interactive

The first 9B model load can take tens of seconds. After [chat:ready], ask a few questions and the answer streams token by token. The CLI uses model-aware generation defaults; override the output length with --max-tokens when needed. Exit with /exit.

Learning Demo

Run the local correction-learning demo once the baseline model is ready:

edge demo learn run \
  --sample finance_conservative_cashflow_v1 \
  --model qwen3.5-9b-4bit \
  --max-tokens 160 \
  --include-text

The demo uses a synthetic finance preference to exercise local receipts, correction capture, Neural Imprint artifact generation, and a follow-up query without bundling internal evaluation data.

For the full walkthrough, SDK integration paths, and API references, use the Edge Developers documentation:

Source Install

Use the source path when contributing to Edge Studio or testing a local checkout:

git clone https://github.com/AtomGradient/edge-studio.git
cd edge-studio
python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install -e ".[dev]"

Launch the packaged UI/API server from the source checkout:

edge studio
open http://127.0.0.1:18842

For frontend development, run Vite separately and keep the backend server running:

npm --prefix frontend ci
npm --prefix frontend run dev
edge studio

The Vite UI runs at http://localhost:5173; the backend stays on http://127.0.0.1:18842.

Build a Wheel

python -m pip install --upgrade build
./scripts/build_wheel.sh

The build script compiles the frontend and copies frontend/dist into package resources before building the wheel, so users installing the wheel do not need Node.js.

Release Checks

python -m pytest tests -q
npm --prefix frontend run lint
npm --prefix frontend run build
python -m build

License

Edge Studio is released under the MIT License. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

edge_studio-0.0.1rc8.tar.gz (3.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

edge_studio-0.0.1rc8-py3-none-any.whl (4.1 MB view details)

Uploaded Python 3

File details

Details for the file edge_studio-0.0.1rc8.tar.gz.

File metadata

  • Download URL: edge_studio-0.0.1rc8.tar.gz
  • Upload date:
  • Size: 3.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc8.tar.gz
Algorithm Hash digest
SHA256 e379603d23dabc9f571ce41bff7b7d688f5e81d8216a42855a49c9c308c8e03c
MD5 be32f19d531c56310964c62348c37a44
BLAKE2b-256 501c1c3374720f51681a2fae1eeca26c2cba205735753bc179e04fecf04cd23b

See more details on using hashes here.

File details

Details for the file edge_studio-0.0.1rc8-py3-none-any.whl.

File metadata

  • Download URL: edge_studio-0.0.1rc8-py3-none-any.whl
  • Upload date:
  • Size: 4.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc8-py3-none-any.whl
Algorithm Hash digest
SHA256 9d9802771d4dec3fa068d4fd202b23a6f02da8b7ff3e3dbd0eab139f80850720
MD5 4bc77d10a8a8beb369e21bbe55803c9e
BLAKE2b-256 2d670236f460e0850c267427b8767d3a31a85dcc9552eeb204a300a099c4ffa9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page