Skip to main content

Edge Studio — on-device LLM optimization workbench for Apple Silicon

Project description

Edge Studio

Edge Studio is AtomGradient's local workbench for building and testing on-device AI products on Apple Silicon. It ships as a Python package with a local Studio UI, an API server, and CLI workflows for model preparation, local chat, and the Neural Imprint learning demo.

Start with the developer documentation when you are building an app or integrating the SDK:

Install

Use Python 3.11 in an isolated environment before installing Edge Studio.

With venv:

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install edge-studio

With uv:

uv venv --python 3.11 .venv
source .venv/bin/activate
uv pip install edge-studio

Current release candidate: 0.0.1rc11.

For a deterministic RC install:

python -m pip install edge-studio==0.0.1rc11

The package installs one command-line entry point:

Command Use
edge Launch Studio, prepare models, run local chat, inspect receipts, and try the learning demo.

Quick Start

python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install edge-studio
edge studio
open http://127.0.0.1:18842

Edge Studio binds to 127.0.0.1:18842 by default. Override the host or port with VLM_HOST and VLM_PORT when you need a different local address.

First Model

The baseline developer-preview model is qwen3.5-9b-4bit.

edge models where qwen3.5-9b-4bit
edge models fetch qwen3.5-9b-4bit --source auto

edge models fetch supports ModelScope, Hugging Face, and hf-mirror sources. The auto mode chooses a source order from the local network environment.

First Chat

Run a local multi-turn chat after the model is available:

edge demo chat --model qwen3.5-9b-4bit --interactive

The first 9B model load can take tens of seconds. After [chat:ready], ask a few questions and the answer streams token by token. The CLI uses model-aware generation defaults; override the output length with --max-tokens when needed. Exit with /exit.

Learning Demo

Run the local correction-learning demo once the baseline model is ready:

edge demo learn run \
  --sample finance_conservative_cashflow_v1 \
  --model qwen3.5-9b-4bit \
  --max-tokens 160 \
  --include-text

The demo uses a synthetic finance preference to exercise local receipts, correction capture, Neural Imprint artifact generation, and a follow-up query without bundling internal evaluation data.

For the full walkthrough, SDK integration paths, and API references, use the Edge Developers documentation:

Source Install

Use the source path when contributing to Edge Studio or testing a local checkout:

git clone https://github.com/AtomGradient/edge-studio.git
cd edge-studio
python3.11 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install -e ".[dev]"

Launch the packaged UI/API server from the source checkout:

edge studio
open http://127.0.0.1:18842

For frontend development, run Vite separately and keep the backend server running:

npm --prefix frontend ci
npm --prefix frontend run dev
edge studio

The Vite UI runs at http://localhost:5173; the backend stays on http://127.0.0.1:18842.

Build a Wheel

python -m pip install --upgrade build
./scripts/build_wheel.sh

The build script compiles the frontend and copies frontend/dist into package resources before building the wheel, so users installing the wheel do not need Node.js.

Release Checks

python -m pytest tests -q
npm --prefix frontend run lint
npm --prefix frontend run build
python -m build

License

Edge Studio is released under the MIT License. See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

edge_studio-0.0.1rc11.tar.gz (3.8 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

edge_studio-0.0.1rc11-py3-none-any.whl (4.1 MB view details)

Uploaded Python 3

File details

Details for the file edge_studio-0.0.1rc11.tar.gz.

File metadata

  • Download URL: edge_studio-0.0.1rc11.tar.gz
  • Upload date:
  • Size: 3.8 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for edge_studio-0.0.1rc11.tar.gz
Algorithm Hash digest
SHA256 61f388fae18e442c708f45e8e1b404858491beb1c8b30ae133031444690624f4
MD5 68544ccbae56f3c345db9ff47e13fba7
BLAKE2b-256 5ca8e16d313f56651a7b44c2bfd760c6f4ba87584a695732c7b65164c2d8f184

See more details on using hashes here.

File details

Details for the file edge_studio-0.0.1rc11-py3-none-any.whl.

File metadata

File hashes

Hashes for edge_studio-0.0.1rc11-py3-none-any.whl
Algorithm Hash digest
SHA256 c5ef7acf80ee37290a23a1f90f5bf83d17112226c68391b2972b15cc1eb85f01
MD5 2b4da6d3b8ea2f4ec3daf6dceda25199
BLAKE2b-256 903d5fe4889b73c2ccbaa5b033d30704355e213bb845df898ef75b9de5e3cf60

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page