Skip to main content

Edge Studio — on-device LLM optimization workbench for Apple Silicon

Project description

Edge Studio

Edge Studio is AtomGradient's local workbench for building and testing on-device AI products on Apple Silicon. It ships as a Python package with a local Studio UI, an API server, and CLI workflows for model preparation, local chat, and the Neural Imprint learning demo.

Start with the developer documentation when you are building an app or integrating the SDK:

Install

Use Python 3.11 in an isolated environment before installing Edge Studio.

With venv:

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install edge-studio

With uv:

uv venv --python 3.11 .venv
source .venv/bin/activate
uv pip install edge-studio

Current release candidate: 0.0.1rc12.

For a deterministic RC install:

python -m pip install edge-studio==0.0.1rc12

The package installs one command-line entry point:

Command Use
edge Launch Studio, prepare models, run local chat, inspect receipts, and try the learning demo.

Quick Start

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install edge-studio
edge studio
open http://127.0.0.1:18842

Edge Studio binds to 127.0.0.1:18842 by default. Override the host or port with VLM_HOST and VLM_PORT when you need a different local address.

First Model

The baseline developer-preview model is qwen3.5-9b-4bit.

edge models where qwen3.5-9b-4bit
edge models fetch qwen3.5-9b-4bit --source auto

edge models fetch supports ModelScope, Hugging Face, and hf-mirror sources. The auto mode chooses a source order from the local network environment.

First Chat

Run a local multi-turn chat after the model is available:

edge demo chat --model qwen3.5-9b-4bit --interactive

The first 9B model load can take tens of seconds. After [chat:ready], ask a few questions and the answer streams token by token. The CLI uses model-aware generation defaults; override the output length with --max-tokens when needed. Exit with /exit.

Learning Demo

Run the local correction-learning demo once the baseline model is ready:

edge demo learn run \
  --sample finance_conservative_cashflow_v1 \
  --model qwen3.5-9b-4bit \
  --max-tokens 160 \
  --include-text

The demo uses a synthetic finance preference to exercise local receipts, correction capture, Neural Imprint artifact generation, and a follow-up query without bundling internal evaluation data.

For the full walkthrough, SDK integration paths, and API references, use the Edge Developers documentation:

Source Install

Use the source path when contributing to Edge Studio or testing a local checkout:

git clone https://github.com/AtomGradient/edge-studio.git
cd edge-studio
python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install -e ".[dev]"

Launch the packaged UI/API server from the source checkout:

edge studio
open http://127.0.0.1:18842

For frontend development, run Vite separately and keep the backend server running:

npm --prefix frontend ci
npm --prefix frontend run dev
edge studio

The Vite UI runs at http://localhost:5173; the backend stays on http://127.0.0.1:18842.

Build a Wheel

python -m pip install --upgrade build
./scripts/build_wheel.sh

The build script compiles the frontend and copies frontend/dist into package resources before building the wheel, so users installing the wheel do not need Node.js.

Release Checks

python -m pytest tests -q
npm --prefix frontend run lint
npm --prefix frontend run build
python -m build

License

Edge Studio is released under the MIT License. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

edge_studio-0.0.1rc12.tar.gz (3.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

edge_studio-0.0.1rc12-py3-none-any.whl (4.1 MB view details)

Uploaded Python 3

File details

Details for the file edge_studio-0.0.1rc12.tar.gz.

File metadata

  • Download URL: edge_studio-0.0.1rc12.tar.gz
  • Upload date:
  • Size: 3.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc12.tar.gz
Algorithm Hash digest
SHA256 14b5fc95caf04b72d52069f9feb319fc125a37fb6972ecfed6e5953d1dc8aab6
MD5 98cb7b2fc727cf6cff19da0b6696bc38
BLAKE2b-256 5039001da62a6a86f3a16bba0fc97163cb25da67530735c688a07b062a8807bd

See more details on using hashes here.

File details

Details for the file edge_studio-0.0.1rc12-py3-none-any.whl.

File metadata

File hashes

Hashes for edge_studio-0.0.1rc12-py3-none-any.whl
Algorithm Hash digest
SHA256 ccb7988623a7f1b14aa73ce19a2940f464ae34341cf71b02ee1abcf76de54de2
MD5 af60f4e5bd0e51e19e01834e93138d7a
BLAKE2b-256 65d6774c8207e9fbb21d7e027e831664a20234936a09186d33589479148f468a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page