hf-inference-acp
Hugging Face inference agent with ACP (Agent Client Protocol) support, powered by fast-agent-mcp.
Installation
uvx hf-inference-acp
What is this?
This package provides an ACP-compatible agent for Hugging Face Inference API. It allows you to use Hugging Face's Inference Providers through any ACP-compatible client (like Toad).
ACP sessions are always connection-scoped.
Features
- Setup Mode: Configure Hugging Face credentials and model settings
- Hugging Face Mode: AI assistant powered by Hugging Face Inference API
- HuggingFace MCP Server: Built-in integration with Hugging Face's MCP server for accessing models, datasets, and spaces
Quick Start
-
Run the agent:
uvx hf-inference-acp -
If
HF_TOKENis not set, you'll start in Setup mode with these commands:/login- Get instructions for HuggingFace authentication/set-model <model>- Set the default model/check- Verify your configuration
-
Once authenticated (HF_TOKEN is set), you'll automatically start in Hugging Face mode.
-
In Hugging Face mode, use
/connectto connect to the Hugging Face MCP server for model/dataset search tools.
Curated Model Aliases
/set-model supports short aliases from fast-agent's curated Hugging Face list, including:
kimiglmminimaxdeepseek4prokimi25(thinking profile)qwen35(thinking profile)qwen35instruct(instruct profile)
Kimi 2.5 aliases resolve to hf.moonshotai/Kimi-K2.5:fireworks-ai with curated defaults:
kimi25:temperature=1.0, top_p=0.95
Qwen 3.5 aliases resolve to hf.Qwen/Qwen3.5-397B-A17B:novita with curated sampling defaults:
qwen35:temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0qwen35instruct:temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0
Configuration
Configuration is stored at ~/.config/hf-inference/hf.config.yaml:
default_model: hf.moonshotai/Kimi-K2-Instruct-0905
mcp:
servers:
huggingface:
url: "https://huggingface.co/mcp?login"
Authentication
Set your HuggingFace token using one of these methods:
-
Environment variable:
export HF_TOKEN=your_token_here
-
HuggingFace CLI:
huggingface-cli login
Get your token from: https://huggingface.co/settings/tokens
License
Apache License 2.0 - See the main repository for details.
More Information
For full documentation and the main project, visit: https://github.com/evalstate/fast-agent
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file hf_inference_acp-0.9.3.tar.gz.
File metadata
- Download URL: hf_inference_acp-0.9.3.tar.gz
- Upload date:
- Size: 30.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7d9be4c3be71c58ebbea49ec057153a9e5cb39a8d79db9f56886eda9092e7d75
|
|
| MD5 |
b81a24f35175831cec8f60467cb3c6ea
|
|
| BLAKE2b-256 |
6252c58850f6b792c2723f18663ffdbeb4efc57dcf7a5920994982eaa46eaf15
|
File details
Details for the file hf_inference_acp-0.9.3-py3-none-any.whl.
File metadata
- Download URL: hf_inference_acp-0.9.3-py3-none-any.whl
- Upload date:
- Size: 33.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.28 {"installer":{"name":"uv","version":"0.11.28","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e573355abbe7549538ed719b3b9523c260e6ac0cb1f20069eb1780279fb322a5
|
|
| MD5 |
e5ea6a17d4c5fcb566ddb28a6ebcde8b
|
|
| BLAKE2b-256 |
85aed3d850229cc8044b32dc66175d8b214e8cd477c2067048e5923bbeb8cf81
|
