Skip to main content
FreeToken-metal

| Paper | Developer Slack | Community Discord | Community WeChat |

Run frontier open-weight MoE models on the Mac you already own: FreeToken for Apple Silicon.

About

FreeToken-metal is the Apple Silicon port of FreeToken, an edge-native MoE serving engine, built on MLX and Metal.

  • Fast on Metal: custom Metal kernels and captured decode steps keep the GPU busy.
  • Prefix caching: multi-turn and agent sessions reuse the context they already sent.
  • MoE offload: models larger than memory serve their experts from the SSD.
  • Models: Qwen3.6-35B-A3B, Gemma 4, Qwen3.8-Flash-Next and Flint, with image input.
  • Agent-ready: OpenAI and Anthropic APIs, and ftm launch for Claude Code, Codex, OpenCode and more.

Runs on Apple Silicon Macs with macOS 15 or later.

Getting Started

Install FreeToken-metal with uv (recommended) or pip:

uv tool install --python 3.13 freetoken-metal
ftm serve --model /path/to/Qwen3.6-35B-A3B-MLX

Or build it from source:

git clone https://github.com/FlashML-org/FreeToken-metal.git && cd FreeToken-metal
./install.sh

Citation

If you use FreeToken-metal for your research, please cite the FreeToken paper:

@article{yang2026freetoken,
  title={FreeToken: Efficient Edge-Native MoE Serving with Bandwidth-Adaptive Execution},
  author={Yang, Shuo and Fan, Xiaoze and Pan, Melissa and Xi, Haocheng and Wang, Zhe and Sun, Shanlin and Keutzer, Kurt and Han, Song and Zaharia, Matei and Xu, Chenfeng and Stoica, Ion},
  journal={arXiv preprint arXiv:2608.16157},
  year={2026}
}

Acknowledgment

FreeToken-metal is the Apple Silicon port of FreeToken and is built on MLX.

License

Apache License 2.0.

Metadata

Release files for freetoken-metal 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distributions (wheels)

Table of built distributions (wheels) for freetoken-metal 0.0.1
File Interpreter ABI Platform Actions
freetoken_metal-0.0.1-cp313-cp313-macosx_15_0_arm64.whl CPython 3.13 CPython 3.13 macOS 15.0+ ARM64 Details for freetoken_metal-0.0.1-cp313-cp313-macosx_15_0_arm64.whl
freetoken_metal-0.0.1-cp312-cp312-macosx_15_0_arm64.whl CPython 3.12 CPython 3.12 macOS 15.0+ ARM64 Details for freetoken_metal-0.0.1-cp312-cp312-macosx_15_0_arm64.whl
freetoken_metal-0.0.1-cp311-cp311-macosx_15_0_arm64.whl CPython 3.11 CPython 3.11 macOS 15.0+ ARM64 Details for freetoken_metal-0.0.1-cp311-cp311-macosx_15_0_arm64.whl

Total release size: 3.1 MB

Release files / freetoken_metal-0.0.1-cp313-cp313-macosx_15_0_arm64.whl

Download URL freetoken_metal-0.0.1-cp313-cp313-macosx_15_0_arm64.whl
Size 1.0 MB
Tags CPython 3.13 macOS 15.0+ ARM64
SHA-256 checksum
How to use checksums
f8581232719a1e5ae5db5dad1b1222b4c08bd0f127ab754ed8d4b1dce557cf1d
BLAKE2b-256 checksum
How to use checksums
073985acbbcb0a009b2f51db7f5e1e916c6c22f5432312dd198bb090530a9e7b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.7 {"installer":{"name":"uv","version":"0.13.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / freetoken_metal-0.0.1-cp312-cp312-macosx_15_0_arm64.whl

Download URL freetoken_metal-0.0.1-cp312-cp312-macosx_15_0_arm64.whl
Size 1.0 MB
Tags CPython 3.12 macOS 15.0+ ARM64
SHA-256 checksum
How to use checksums
2a395442e97afcfc0cc03dab6fc7089b28f34c7a7dea4b659032b45b1abf7ffb
BLAKE2b-256 checksum
How to use checksums
696d80749d36f7e6eeea8d20829db3be29bb4f82ac1905ea66eff6dfdb24d0a8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.7 {"installer":{"name":"uv","version":"0.13.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / freetoken_metal-0.0.1-cp311-cp311-macosx_15_0_arm64.whl

Download URL freetoken_metal-0.0.1-cp311-cp311-macosx_15_0_arm64.whl
Size 1.0 MB
Tags CPython 3.11 macOS 15.0+ ARM64
SHA-256 checksum
How to use checksums
5f16cf4741a9b48ca69c213418149949f13442f9e7f610e7a4cd5ff6e083bf2e
BLAKE2b-256 checksum
How to use checksums
e64d0feaad68cb2f927736e27a7429922ccacc175cfb405b68ff0744675574c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.13.7 {"installer":{"name":"uv","version":"0.13.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for freetoken-metal 0.0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.0.1 This release

3 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page