Flash

Managed LoRA post-training service: SFT, GRPO, and on-policy distillation (from a Fireworks-hosted GLM teacher) on managed Flash GPUs. The allocator picks the cheapest validated managed GPU class that fits the run.

Scope

  • flash train <cfg.toml> / control-plane POST /runs — submit a training job; one dedicated GPU per run, supervised server-side (stall watchdog, bounded auto-retry resuming from the last streamed checkpoint, endpoint GC).
  • flash checkpoints, flash deploy, flash chat — serving for trained adapters, including deployable intermediate RL checkpoints.
  • Freesolo SDK environments. Every run names a Freesolo environment id. Scaffold environment.py plus dataset/train.jsonl, upload . or another folder with flash env push --name <name> <folder>, then reference the returned id. The worker loads it through freesolo.environments. There are no built-in task environments. Single-turn and bounded multi-turn environments are supported.

Layout

  • flash/catalog.py — curated model catalog (Qwen3 dense supported tier; Qwen3.5/3.6 experimental tier), VRAM-fit sizing, and each model's thinking capability (opt-in reasoning mode thinking = true)
  • flash/schema.py, flash/spec.py — TOML → JobSpec
  • flash/runner.py — server-side run supervisor (durable job handle, retries, cost guard, endpoint GC)
  • flash/providers/ — managed GPU substrate code (pricing, GPU classes, durable submit/poll, preflight) behind the base.Provider protocol, with an allocator.py that picks the cheapest fitting managed GPU class
  • flash/engine/ — the on-GPU worker (TRL + colocated vLLM rollouts; distillation scores on-policy student samples against a remote GLM teacher) and the shared recipe; SFT targets and RL rewards route through the active environment (task-specific grading lives with its example, not in the engine)
  • flash/envs/ — environment machinery: registry and the adapter that loads Freesolo SDK environments onto the worker's interface
  • flash env setup — scaffold a starter local Freesolo env, dataset/train.jsonl, ready-to-run configs, and a TRAINING.md playbook with common failure modes and mitigations
  • flash/serve/, flash/server/ — adapter serving and the FastAPI control plane (run operator-side via the separate flash-server command)
  • Dockerfile — the control-plane image (used by the repo docker-compose)
  • tests/ — pytest suite (CPU-only; offline-by-default, no GPU/network)

Local commands

cd flash
uv sync --extra server
uv run pytest                           # CPU tests (offline-by-default, no GPU/network)
uv run ruff check . && uv run ruff format .
uv run flash --help
uv run flash-server                      # control plane (operator-side, run once)

The control plane owns infrastructure credentials plus the shared HF_TOKEN. The artifact repo is platform-managed and environment-scoped (runs for the same environment share one private Freesolo-Co/flashrun-<environment>-<hash> repo, written by the operator HF_TOKEN); Flash uploads code under content-addressed prefixes and only reuses completed snapshots. The repo is not a user knob and not an operator-wide env var. Clients authenticate with their freesolo API key (flash login).

Release channels

Two channels are published to PyPI from the same source, distinguished by one line in flash/_channel.py (CHANNEL):

Channel PyPI package CLI Default plane Published from
prod freesolo-flash flash flash.freesolo.co push to main that bumps [project].version (.github/workflows/publish.yml)
dev freesolo-flash-dev flash-dev flash-dev.freesolo.co push to dev whose [tool.flash-dev].version isn't on PyPI yet (.github/workflows/publish-dev.yml)

Each environment holds exactly one channel: both packages ship the same import package (flash/) with one baked CHANNEL line, so installing both into the same environment makes the later install win for both CLIs. For side-by-side prod and staging, install each channel in its own virtualenv (or via pipx, which isolates per tool). The dev build is produced by scripts/build_dev_dist.py, which renames the package/CLI and flips CHANNEL to dev before uv build. Both channels ship at the same version: [project].version and [tool.flash-dev].version must match (CI enforces this via .github/workflows/version-parity.yml), so cutting a release means bumping both together. Either CLI still honours an explicit FLASH_API_URL / the login --api-url flag; the channel only sets the default.

Serving From an API

flash chat is a CLI wrapper around the Flash control-plane chat endpoint. To call a deployed adapter from your own app, deploy the finished run once and then POST chat requests with your freesolo API key:

export FLASH_API_URL=https://flash.freesolo.co
export FREESOLO_API_KEY=fslo_...
export RUN_ID=flash-1782194170-ce1cfcff

curl -X POST "$FLASH_API_URL/v1/runs/$RUN_ID/deploy" \
  -H "Authorization: Bearer $FREESOLO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"dry_run": false}'

curl -X POST "$FLASH_API_URL/v1/runs/$RUN_ID/chat" \
  -H "Authorization: Bearer $FREESOLO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "messages": [
      {"role": "user", "content": "Write a two-sentence summary of the run."}
    ],
    "temperature": 0.0,
    "max_tokens": 256
  }'

The response uses the OpenAI chat-completions shape:

{
  "choices": [
    {
      "message": {
        "role": "assistant",
        "content": "..."
      }
    }
  ]
}

Use choices[0].message.content for the generated text. The run id is the adapter id for serving. If the run is not deployed yet, /v1/runs/<run_id>/chat returns 409 with a hint to deploy first.

Operators can also call the serving backend directly after the adapter is registered. The default serving backend is https://serve.freesolo.co, and operators can point Flash at another backend by setting FREESOLO_SERVING_URL. Use that same base URL when calling the backend directly; pass the run id as model:

export FREESOLO_SERVING_URL=https://serve.freesolo.co

curl -X POST "$FREESOLO_SERVING_URL/v1/chat/completions" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "flash-1782194170-ce1cfcff",
    "messages": [{"role": "user", "content": "Hello"}],
    "temperature": 0.0,
    "max_tokens": 256
  }'

Prefer the Flash control-plane endpoint for user apps because it enforces run ownership and forwards per-run serving options such as thinking-mode parity.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (1.1.69)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for Freesolo from gravatar.com Freesolo

Credits

Author: Freesolo

License expression

Apache-2.0
View SPDX License List

Requires

Python <3.13, >=3.11

Provides Extra

dev gpu server

Tags

fine-tuning freesolo grpo llm lora rl sft

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

freesolo_flash_dev-1.0.18.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

freesolo_flash_dev-1.0.18-py3-none-any.whl (700.7 kB view details)

Uploaded Python 3

File details

Details for the file freesolo_flash_dev-1.0.18.tar.gz.

File metadata

  • Download URL: freesolo_flash_dev-1.0.18.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for freesolo_flash_dev-1.0.18.tar.gz
Algorithm Hash digest
SHA256 9ebf3a6a44892399a3f647fd50f8a8842d6242e4c089774030bcac986ff27999
MD5 d6580b3a148ba3c3aaeecaa9819279e0
BLAKE2b-256 812c2259f84544323bfdf8e33d31c04c011585ab8ad34f2ed7e12d3525eabb9e

See more details on using hashes here.

File details

Details for the file freesolo_flash_dev-1.0.18-py3-none-any.whl.

File metadata

  • Download URL: freesolo_flash_dev-1.0.18-py3-none-any.whl
  • Upload date:
  • Size: 700.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.32 {"installer":{"name":"uv","version":"0.11.32","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for freesolo_flash_dev-1.0.18-py3-none-any.whl
Algorithm Hash digest
SHA256 c13d1eebfa3110bf928c454d410e3cb58ae84eaf4227ddbc84075eca32c0400c
MD5 8deca5cd199daa4ad9ef8283c97219cd
BLAKE2b-256 d2bbe5ed530dae398e1954e9b9127f8ac770d034a9e551dc5cca503d3afc6249

See more details on using hashes here.

Release history Release notifications | RSS feed

1.1.69

1.1.68

1.1.67

1.1.66

1.1.65

1.1.64

1.1.63

1.1.61

1.1.59

1.1.58

1.1.57

1.1.55

1.1.54

1.1.52

1.1.51

1.1.48

1.1.47

1.1.46

1.1.45

1.1.44

1.1.43

1.1.42

1.1.41

1.1.40

1.1.39

1.1.38

1.1.37

1.1.35

1.1.32

1.1.31

1.1.30

1.1.29

1.1.28

1.1.27

1.1.26

1.1.25

1.1.24

1.1.23

1.1.22

1.1.21

1.1.20

1.1.19

1.1.18

1.1.17

1.1.16

1.1.15

1.1.14

1.1.13

1.1.12

1.1.11

1.1.10

1.1.9

1.1.8

1.1.7

1.1.6

1.1.5

1.1.3

1.1.2

1.1.0

1.0.100

1.0.99

1.0.98

1.0.97

1.0.96

1.0.95

1.0.94

1.0.93

1.0.92

1.0.91

1.0.90

1.0.89

1.0.88

1.0.87

1.0.86

1.0.85

1.0.84

1.0.83

1.0.82

1.0.81

1.0.80

1.0.79

1.0.78

1.0.77

1.0.76

1.0.75

1.0.74

1.0.73

1.0.72

1.0.71

1.0.70

1.0.68

1.0.67

1.0.66

1.0.65

1.0.64

1.0.63

1.0.62

1.0.61

1.0.60

1.0.59

1.0.58

1.0.57

1.0.56

1.0.55

1.0.54

1.0.53

1.0.52

1.0.51

1.0.50

1.0.49

1.0.48

1.0.47

1.0.46

1.0.45

1.0.44

1.0.43

1.0.42

1.0.41

1.0.40

1.0.39

1.0.38

1.0.37

1.0.36

1.0.35

1.0.34

1.0.32

1.0.31

1.0.30

1.0.29

1.0.28

1.0.27

1.0.26

1.0.24

1.0.23

1.0.22

1.0.21

1.0.20

1.0.19

This release

1.0.18

1.0.17

1.0.16

1.0.15

1.0.14

1.0.13

1.0.12

1.0.11

1.0.10

1.0.9

1.0.8

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.2.58

0.2.57

0.2.56

0.2.55

0.2.54

0.2.50

0.2.49

0.2.48

0.2.47

0.2.46

0.2.45

0.2.44

0.2.43

0.2.42

0.2.41

0.2.40

0.2.39

0.2.38

0.2.37

0.2.36

0.2.35

0.2.34

0.2.33

0.2.32

0.2.31

0.2.30

0.2.29

0.2.28

0.2.27

0.2.26

0.2.25

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page