Skip to main content

hf-inference-acp

Hugging Face inference agent with ACP (Agent Client Protocol) support, powered by fast-agent-mcp.

Installation

uvx hf-inference-acp

What is this?

This package provides an ACP-compatible agent for Hugging Face Inference API. It allows you to use Hugging Face's Inference Providers through any ACP-compatible client (like Toad).

ACP sessions are always connection-scoped.

Features

  • Setup Mode: Configure Hugging Face credentials and model settings
  • Hugging Face Mode: AI assistant powered by Hugging Face Inference API
  • HuggingFace MCP Server: Built-in integration with Hugging Face's MCP server for accessing models, datasets, and spaces

Quick Start

  1. Run the agent:

    uvx hf-inference-acp
    
  2. If HF_TOKEN is not set, you'll start in Setup mode with these commands:

    • /login - Get instructions for HuggingFace authentication
    • /set-model <model> - Set the default model
    • /check - Verify your configuration
  3. Once authenticated (HF_TOKEN is set), you'll automatically start in Hugging Face mode.

  4. In Hugging Face mode, use /connect to connect to the Hugging Face MCP server for model/dataset search tools.

Curated Model Aliases

/set-model supports short aliases from fast-agent's curated Hugging Face list, including:

  • kimi
  • glm
  • minimax
  • deepseek4pro
  • kimi25 (thinking profile)
  • qwen35 (thinking profile)
  • qwen35instruct (instruct profile)

Kimi 2.5 aliases resolve to hf.moonshotai/Kimi-K2.5:fireworks-ai with curated defaults:

  • kimi25: temperature=1.0, top_p=0.95

Qwen 3.5 aliases resolve to hf.Qwen/Qwen3.5-397B-A17B:novita with curated sampling defaults:

  • qwen35: temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0
  • qwen35instruct: temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0

Configuration

Configuration is stored at ~/.config/hf-inference/hf.config.yaml:

default_model: hf.moonshotai/Kimi-K2-Instruct-0905

mcp:
  servers:
    huggingface:
      url: "https://huggingface.co/mcp?login"

Authentication

Set your HuggingFace token using one of these methods:

  1. Environment variable:

    export HF_TOKEN=your_token_here
    
  2. HuggingFace CLI:

    huggingface-cli login
    

Get your token from: https://huggingface.co/settings/tokens

License

Apache License 2.0 - See the main repository for details.

More Information

For full documentation and the main project, visit: https://github.com/evalstate/fast-agent

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hf_inference_acp-0.10.12.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hf_inference_acp-0.10.12-py3-none-any.whl (33.6 kB view details)

Uploaded Python 3

File details

Details for the file hf_inference_acp-0.10.12.tar.gz.

File metadata

  • Download URL: hf_inference_acp-0.10.12.tar.gz
  • Upload date:
  • Size: 29.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hf_inference_acp-0.10.12.tar.gz
Algorithm Hash digest
SHA256 f9d4a1592e55b1483e6b773660c76b17d8431b90e7e58c531d49057e6f97cc7a
MD5 1cdd38a514725f5f8ff5c0777f326377
BLAKE2b-256 86d3bdffed399f1cb372ba7404c2d088405ce79cc9dcb4954c49686635687bdb

See more details on using hashes here.

File details

Details for the file hf_inference_acp-0.10.12-py3-none-any.whl.

File metadata

  • Download URL: hf_inference_acp-0.10.12-py3-none-any.whl
  • Upload date:
  • Size: 33.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for hf_inference_acp-0.10.12-py3-none-any.whl
Algorithm Hash digest
SHA256 6121d03d9a8cceba76fdcc14dd03158915dd7dc75f2415cf44e42ba759ae0bac
MD5 a7beef6af4d13a8885663b536ff06f9b
BLAKE2b-256 77e52edef0f18afcf437b4434e0f0dbb4cdff7d53b3dd9568edcd3e43a267def

See more details on using hashes here.

Release history Release notifications | RSS feed

0.10.24

2 files

0.10.23

2 files

0.10.22

2 files

0.10.21

2 files

0.10.20

2 files

0.10.19

2 files

0.10.18

2 files

0.10.17

2 files

0.10.16

2 files

0.10.15

2 files

0.10.14

2 files

0.10.13

2 files

This release

0.10.12 This release

2 files

0.10.11

2 files

0.10.10

2 files

0.10.9

2 files

0.10.8

2 files

0.10.7

2 files

0.10.6

2 files

0.10.5

2 files

0.10.4

2 files

0.10.3

2 files

0.10.2

2 files

0.10.1

2 files

0.10.0

2 files

0.9.30

2 files

0.9.29

2 files

0.9.28

2 files

0.9.27

2 files

0.9.26

2 files

0.9.25

2 files

0.9.24

2 files

0.9.23

2 files

0.9.22

2 files

0.9.21

2 files

0.9.20

2 files

0.9.19

2 files

0.9.18

2 files

0.9.17

2 files

0.9.16

2 files

0.9.15

2 files

0.9.14

2 files

0.9.13

2 files

0.9.12

2 files

0.9.10

2 files

0.9.9

2 files

0.9.8

2 files

0.9.7

2 files

0.9.6

2 files

0.9.5

2 files

0.9.4

2 files

0.9.3

2 files

0.9.2

2 files

0.9.1

2 files

0.9.0

2 files

0.8.3

2 files

0.8.2

2 files

0.8.1

2 files

0.8.0

2 files

0.7.22

2 files

0.7.21

2 files

0.7.20

2 files

0.7.19

2 files

0.7.18

2 files

0.7.17

2 files

0.7.16

2 files

0.7.15

2 files

0.7.14

2 files

0.7.13

2 files

0.7.12

2 files

0.7.11

2 files

0.7.10

2 files

0.7.9

2 files

0.7.8

2 files

0.7.7

2 files

0.7.6

2 files

0.7.5

2 files

0.7.4

2 files

0.7.3

2 files

0.7.2

2 files

0.7.1

2 files

0.7.0

2 files

0.6.26

2 files

0.6.25

2 files

0.6.24

2 files

0.6.23

2 files

0.6.22

2 files

0.6.21

2 files

0.6.20

2 files

0.6.19

2 files

0.6.18

2 files

0.6.17

2 files

0.6.16

2 files

0.6.15

2 files

0.6.14

2 files

0.6.13

2 files

0.6.12

2 files

0.6.11

2 files

0.6.10

2 files

0.6.9

2 files

0.6.8

2 files

0.6.7

2 files

0.6.6

2 files

0.6.5

2 files

0.6.4

2 files

0.6.3

2 files

0.6.2

2 files

0.6.1

2 files

0.6.0

2 files

0.5.11

2 files

0.5.10

2 files

0.5.9

2 files

0.5.8

2 files

0.5.7

2 files

0.5.6

2 files

0.5.5

2 files

0.5.4

2 files

0.5.3

2 files

0.5.2

2 files

0.5.1

2 files

0.5.0

2 files

0.4.56

2 files

0.4.55

2 files

0.4.54

2 files

0.4.53

2 files

0.4.52

2 files

0.4.51

2 files

0.4.50

2 files

0.4.49

2 files

0.4.48

2 files

0.4.47

2 files

0.4.46

2 files

0.4.45

2 files

0.4.44

2 files

0.4.43

2 files

0.4.42

2 files

0.4.41

2 files

0.4.40

2 files

0.4.39

2 files

0.4.38

2 files

0.4.37

2 files

0.4.36

2 files

0.4.35

2 files

0.4.34

2 files

0.4.33

2 files

0.4.32

2 files

0.4.31

2 files

0.4.30

2 files

0.4.29

2 files

0.4.28

2 files

0.4.27

2 files

0.4.26

2 files

0.4.25

2 files

0.4.24

2 files

0.4.23

2 files

0.4.22

2 files

0.4.21

2 files

0.4.20

2 files

0.4.19

2 files

0.4.18

2 files

0.4.17

2 files

0.4.16

2 files

0.4.15

2 files

0.4.14

2 files

0.4.13

2 files

0.4.12

2 files

0.4.11

2 files

0.4.10

2 files

0.4.9

2 files

0.4.8

2 files

0.4.7

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page