Skip to main content

hf-inference-acp

Hugging Face inference agent with ACP (Agent Client Protocol) support, powered by fast-agent-mcp.

Installation

uvx hf-inference-acp

What is this?

This package provides an ACP-compatible agent for Hugging Face Inference API. It allows you to use Hugging Face's Inference Providers through any ACP-compatible client (like Toad).

ACP sessions are always connection-scoped.

Features

  • Setup Mode: Configure Hugging Face credentials and model settings
  • Hugging Face Mode: AI assistant powered by Hugging Face Inference API
  • HuggingFace MCP Server: Built-in integration with Hugging Face's MCP server for accessing models, datasets, and spaces

Quick Start

  1. Run the agent:

    uvx hf-inference-acp
    
  2. If HF_TOKEN is not set, you'll start in Setup mode with these commands:

    • /login - Get instructions for HuggingFace authentication
    • /set-model <model> - Set the default model
    • /check - Verify your configuration
  3. Once authenticated (HF_TOKEN is set), you'll automatically start in Hugging Face mode.

  4. In Hugging Face mode, use /connect to connect to the Hugging Face MCP server for model/dataset search tools.

Curated Model Aliases

/set-model supports short aliases from fast-agent's curated Hugging Face list, including:

  • kimi
  • glm
  • minimax
  • deepseek4pro
  • kimi25 (thinking profile)
  • qwen35 (thinking profile)
  • qwen35instruct (instruct profile)

Kimi 2.5 aliases resolve to hf.moonshotai/Kimi-K2.5:fireworks-ai with curated defaults:

  • kimi25: temperature=1.0, top_p=0.95

Qwen 3.5 aliases resolve to hf.Qwen/Qwen3.5-397B-A17B:novita with curated sampling defaults:

  • qwen35: temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0
  • qwen35instruct: temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0

Configuration

Configuration is stored at ~/.config/hf-inference/hf.config.yaml:

default_model: hf.moonshotai/Kimi-K2-Instruct-0905

mcp:
  servers:
    huggingface:
      url: "https://huggingface.co/mcp?login"

Authentication

Set your HuggingFace token using one of these methods:

  1. Environment variable:

    export HF_TOKEN=your_token_here
    
  2. HuggingFace CLI:

    huggingface-cli login
    

Get your token from: https://huggingface.co/settings/tokens

License

Apache License 2.0 - See the main repository for details.

More Information

For full documentation and the main project, visit: https://github.com/evalstate/fast-agent

Release files for hf-inference-acp 0.10.28

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for hf-inference-acp 0.10.28
File Size Uploaded
hf_inference_acp-0.10.28.tar.gz 29.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for hf-inference-acp 0.10.28
File Interpreter ABI Platform
hf_inference_acp-0.10.28-py3-none-any.whl Python 3 none any Details

Total release size: 63.3 kB

Release files / hf_inference_acp-0.10.28.tar.gz

Download URL hf_inference_acp-0.10.28.tar.gz
Size 29.7 kB
Tags Source
SHA-256 checksum
How to use checksums
c4fb6b375b55fbc97d5cb8d376f2e395162ef67e23c89337e6df0d4f88e0beee
BLAKE2b-256 checksum
How to use checksums
e99e256b2d2bde4973c3e73a42c1ec83ee717e8f75e54684f982cbc2ac20ad7e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.17 {"installer":{"name":"uv","version":"0.12.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / hf_inference_acp-0.10.28-py3-none-any.whl

Download URL hf_inference_acp-0.10.28-py3-none-any.whl
Size 33.6 kB
Tags Python 3
SHA-256 checksum
How to use checksums
d195e7fbfe8629f9dc54e6a4c06a7ddf2eed8991ced264334b598ecd2b5c3336
BLAKE2b-256 checksum
How to use checksums
0a59ffd9978b2ab7a514ac1dff4c7da9ee1f0770f65c0de5b0b46f22db2cdc59
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.17 {"installer":{"name":"uv","version":"0.12.17","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

This release

0.10.28 This release

2 release files

0.10.9

2 release files

0.10.8

2 release files

0.10.7

2 release files

0.10.6

2 release files

0.10.5

2 release files

0.9.29

2 release files

0.9.28

2 release files

0.9.27

2 release files

0.9.26

2 release files

0.9.25

2 release files

0.9.24

2 release files

0.9.23

2 release files

0.9.22

2 release files

0.9.21

2 release files

0.9.20

2 release files

0.9.19

2 release files

0.9.18

2 release files

0.9.17

2 release files

0.9.16

2 release files

0.9.15

2 release files

0.9.14

2 release files

0.9.13

2 release files

0.9.12

2 release files

0.9.10

2 release files

0.9.9

2 release files

0.9.8

2 release files

0.9.7

2 release files

0.9.6

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.1

2 release files

0.9.0

2 release files

0.8.3

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.22

2 release files

0.7.21

2 release files

0.7.20

2 release files

0.7.19

2 release files

0.7.18

2 release files

0.7.17

2 release files

0.7.14

2 release files

0.7.13

2 release files

0.7.12

2 release files

0.7.11

2 release files

0.7.10

2 release files

0.7.9

2 release files

0.7.8

2 release files

0.7.7

2 release files

0.7.6

2 release files

0.7.5

2 release files

0.7.4

2 release files

0.7.3

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.26

2 release files

0.6.25

2 release files

0.6.24

2 release files

0.6.23

2 release files

0.6.22

2 release files

0.6.21

2 release files

0.6.20

2 release files

0.6.19

2 release files

0.6.18

2 release files

0.6.17

2 release files

0.6.16

2 release files

0.6.15

2 release files

0.6.14

2 release files

0.6.10

2 release files

0.6.9

2 release files

0.6.8

2 release files

0.6.7

2 release files

0.6.6

2 release files

0.6.5

2 release files

0.6.4

2 release files

0.6.3

2 release files

0.6.2

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.11

2 release files

0.5.10

2 release files

0.5.9

2 release files

0.5.8

2 release files

0.5.7

2 release files

0.5.6

2 release files

0.5.5

2 release files

0.5.4

2 release files

0.5.3

2 release files

0.5.2

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.56

2 release files

0.4.55

2 release files

0.4.54

2 release files

0.4.53

2 release files

0.4.52

2 release files

0.4.51

2 release files

0.4.45

2 release files

0.4.44

2 release files

0.4.43

2 release files

0.4.42

2 release files

0.4.41

2 release files

0.4.40

2 release files

0.4.39

2 release files

0.4.38

2 release files

0.4.37

2 release files

0.4.36

2 release files

0.4.35

2 release files

0.4.34

2 release files

0.4.33

2 release files

0.4.32

2 release files

0.4.31

2 release files

0.4.30

2 release files

0.4.29

2 release files

0.4.28

2 release files

0.4.27

2 release files

0.4.19

2 release files

0.4.18

2 release files

0.4.17

2 release files

0.4.16

2 release files

0.4.15

2 release files

0.4.14

2 release files

0.4.13

2 release files

0.4.12

2 release files

0.4.11

2 release files

0.4.10

2 release files

0.4.9

2 release files

0.4.8

2 release files

0.4.7

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page