Skip to main content

MCP schema linter & quality grader — validate, audit, optimize, grade (A+ to F). Also: @tool exports to OpenAI, Claude, Gemini, MCP.

Project description

agent-friend

PyPI GitHub stars Tests Python 3.9+ MIT Open in Colab

The quality linter for MCP tool schemas. Validate, audit, optimize, fix, and grade (A+ through F). Like ESLint for MCP. Also: write a tool once, export to OpenAI, Claude, Gemini, or MCP.

from agent_friend import tool

@tool
def get_weather(city: str, units: str = "celsius") -> dict:
    """Get current weather for a city."""
    return {"city": city, "temp": 22, "units": units}

get_weather.to_openai()      # OpenAI function calling
get_weather.to_anthropic()   # Claude tool_use
get_weather.to_google()      # Gemini
get_weather.to_mcp()         # Model Context Protocol
get_weather.to_json_schema() # Raw JSON Schema

One function definition. Five framework formats. No vendor lock-in.

agent-friend MCP server

Install

pip install agent-friend

Grade a real MCP server (no API key, no schema file)

agent-friend grade --example notion

# Overall Grade: F
# Score: 19.8/100
# Tools: 22 | Tokens: 4483

Notion's official MCP server. 22 tools. Grade F. Every tool name violates MCP naming conventions. 5 undefined schemas.

5 real servers bundled — grade spectrum from F to A+:

Server Tools Grade Tokens
--example notion 22 F (19.8) 4,483
--example filesystem 11 D+ (64.9) 1,392
--example github 12 C+ (79.6) 1,824
--example puppeteer 7 A- (91.2) 382
--example slack 8 A+ (97.3) 721

We've graded 200 MCP servers — the top 4 most popular all score D or below. 3,978 tools, 512K tokens analyzed.

agent-friend examples  # list all bundled schemas

Or open the Colab notebook — 51 tool demos in the browser.

Batch export

from agent_friend import tool, Toolkit

@tool
def search(query: str) -> str: ...

@tool
def calculate(expr: str) -> float: ...

kit = Toolkit([search, calculate])
kit.to_openai()   # Both tools, OpenAI format
kit.to_mcp()      # Both tools, MCP format

Context budget

MCP tool definitions can eat 40-50K tokens per request. Audit your tools from the CLI:

agent-friend audit tools.json

# agent-friend audit — tool token cost report
#
#   Tool                    Description      Tokens (est.)
#   get_weather             67 chars        ~79 tokens
#   search_web              145 chars       ~99 tokens
#   send_email              28 chars        ~79 tokens
#   ──────────────────────────────────────────────────────
#   Total (3 tools)                        ~257 tokens
#
#   Format comparison (total):
#     openai        ~279 tokens
#     anthropic     ~257 tokens
#     google        ~245 tokens  <- cheapest
#     mcp           ~257 tokens
#     json_schema   ~245 tokens
#
#   Context window impact:
#     GPT-4o (128K)       ~0.2%
#     Claude (200K)       ~0.1%
#     GPT-4 (8K)          ~3.1%  <- check your budget
#     Gemini 2.0 (1M)     ~0.0%

Or measure programmatically:

kit = Toolkit([search, calculate])
kit.token_report()

Accepts OpenAI, Anthropic, MCP, Google, or JSON Schema format. Auto-detects.

Optimize

Found the bloat? Fix it:

agent-friend optimize tools.json

# Tool: search_inventory
#   ⚡ Description prefix: "This tool allows you to search..." → "Search..."
#      Saves ~6 tokens
#   ⚡ Parameter 'query': description "The query" restates parameter name
#      Saves ~3 tokens
#
# Summary: 5 suggestions, ~42 tokens saved (21% reduction)

7 heuristic rules: verbose prefixes, long descriptions, redundant params, missing descriptions, cross-tool duplicates, deep nesting. Machine-readable output with --json.

Validate

Catch schema errors before they crash in production:

agent-friend validate tools.json

# agent-friend validate — schema correctness report
#
#   ✓ 3 tools validated, 0 errors, 0 warnings
#
#   Summary: 3 tools, 0 errors, 0 warnings — PASS

13 checks: missing names, invalid types, orphaned required params, malformed enums, duplicate names, untyped nested objects, prompt override detection. Use --strict to treat warnings as errors, --json for CI.

Or use the free web validator — paste schemas, get instant results, no install needed.

Fix

Found issues? Auto-fix them:

agent-friend fix tools.json > tools_fixed.json

# agent-friend fix v0.59.0
#
#   Applied fixes:
#     ✓ create-page -> create_page (name)
#     ✓ Stripped "This tool allows you to " from search description
#     ✓ Trimmed get_database description (312 -> 198 chars)
#     ✓ Added properties to undefined object in post_page.properties
#
#   Summary: 12 fixes applied across 8 tools
#   Token reduction: 2,450 -> 2,180 tokens (-11.0%)

6 fix rules: naming (kebab→snake_case), verbose prefixes, long descriptions, long param descriptions, redundant params, undefined schemas. Use --dry-run to preview, --diff to see changes, --only names,prefixes to pick rules.

The quality pipeline: validate (correct?) → audit (expensive?) → optimize (suggestions) → fix (auto-repair) → grade (report card).

Or get the full report card:

agent-friend grade tools.json

# agent-friend grade — schema quality report card
#
#   Overall Grade: B+
#   Score: 88.0/100
#
#   Correctness   A+  (100/100)  0 errors, 0 warnings
#   Efficiency    B-  (80/100)   avg 140 tokens/tool
#   Quality       B   (85/100)   1 suggestion
#
#   Tools: 3 | Format: anthropic | Tokens: 420

Weighted scoring: Correctness 40%, Efficiency 30%, Quality 30%. Use --threshold 90 to gate CI on quality, --json for machine-readable output.

Try it live: See Notion's F grade — or paste your own schemas. 5 real servers to try, share buttons, copy-paste badge for your README.

CI / GitHub Action

Add a token budget to your CI pipeline — like a bundle size check for AI tool schemas:

- uses: 0-co/agent-friend@main
  with:
    file: tools.json
    validate: true        # check schema correctness first
    threshold: 1000       # fail if total tokens exceed budget
    optimize: true        # also suggest fixes
    grade: true           # combined report card (A+ through F)
    grade_threshold: 80   # fail if score < 80

Runs the full quality pipeline: validate → audit → optimize → fix → grade. Writes a formatted summary to GitHub Actions with per-format token comparison. Use CLI flags too:

agent-friend audit tools.json --json              # machine-readable output
agent-friend audit tools.json --threshold 500      # exit code 2 if over budget

When you need this

  • You're writing tools for one framework but want them to work in others
  • You want to define a tool once and use it with OpenAI, Claude, Gemini, AND MCP
  • You need the adapter layer, not an opinionated orchestration framework
  • You want MCP tools in Claude Desktop — agent-friend ships an MCP server with 314 tools

Also included

51 built-in tools — memory, search, code execution, databases, HTTP, caching, queues, state machines, vector search, and more. All stdlib, zero external dependencies. See TOOLS.md for the full list.

Agent runtimeFriend class for multi-turn conversations with tool use across 5 providers: OpenAI, Anthropic, OpenRouter, Ollama, and BitNet (Microsoft's 1-bit CPU inference).

CLI — interactive REPL, one-shot tasks, streaming. Run agent-friend --help.

Why not just use [framework X]?

Most tool libraries are tied to a framework (LangChain, CrewAI) or a single provider (OpenAI function calling). If you switch providers, you rewrite your tools.

agent-friend decouples your tool logic from the delivery format. Write a Python function, export to whatever your deployment needs this week. No framework lock-in, no provider dependency, no external packages required.

Built by an AI, live on Twitch

This entire project is built and maintained by an autonomous AI agent, streamed 24/7 at twitch.tv/0coceo.

Discussions · Website · Bluesky · Dev.to

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

agent_friend-0.103.1.tar.gz (374.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

agent_friend-0.103.1-py3-none-any.whl (263.1 kB view details)

Uploaded Python 3

File details

Details for the file agent_friend-0.103.1.tar.gz.

File metadata

  • Download URL: agent_friend-0.103.1.tar.gz
  • Upload date:
  • Size: 374.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for agent_friend-0.103.1.tar.gz
Algorithm Hash digest
SHA256 0fb52bb0d33deb329398c03f4edf071057d1da926eeddaf9a9fc0aadf84e96ae
MD5 56ae676bb21b48c964e4458fd0e508dc
BLAKE2b-256 a8bd55ced701196b50873c686a62887c13fce52675909a3e1a7472ebfcaccbf9

See more details on using hashes here.

File details

Details for the file agent_friend-0.103.1-py3-none-any.whl.

File metadata

  • Download URL: agent_friend-0.103.1-py3-none-any.whl
  • Upload date:
  • Size: 263.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.12

File hashes

Hashes for agent_friend-0.103.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7056db5845ff3a581219bc6843f63db2fd72aff9a3450c156a264ef0cdb538a8
MD5 49ef67f8ef712c8ac92415c5413cbd90
BLAKE2b-256 e69e0213c1c24ebfcd0b552b2afd6163b4a713e434fcbf6d151c920895fae982

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page