Future AGI MCP Server

A powerful server implementation that integrates with the Future AGI SDK through the Model Context Protocol (MCP). This server provides tools which can be used to interact with Future AGI features.

Features

Run automatic evaluations — Evaluate batch and single inputs on various evaluation metrics present in Future AGI both on local datapoints and large datasets

Manage datasets — Upload, evaluate, download datasets and find insights with natural language

Installation

1. Clone the repository:

git clone https://github.com/future-agi/futureagi-mcp-server.git
cd futureagi-mcp-server

2. Install uv

brew install uv

3. Install dependencies:

uv sync   # this will create a virtual environment if not present and installs necessary dependencies

Configuring the Server to MCP Clients

Create an account at http://app.futureagi.com/ and obtain your API key and Secret key from the dashboard. These credentials are required for the Future AGI MCP Server to authenticate with our API. Export them by running the following command in your terminal

export FI_API_KEY="your_api_key"
export FI_SECRET_KEY="your_secret_key"

To run the server locally and debugging issues:

python main.py

To Configure with MCP Clients like VS Code and Claude using local forked repository. Use this for testing your code changes using client

{
  "mcpServers": {
    "FutureAGI-MCP": {
      "command": "uv",
      "args": [
        "--directory",
        "/path/to/futureagi-mcp-server",
        "run",
        "main.py"
      ],
      "env": {
        "FI_SECRET_KEY": "your_api_key",
        "FI_API_KEY": "your_secret_key",
        "FI_BASE_URL": "https://api.futureagi.com",
        "PYTHONPATH": "/path/to/futureagi-mcp-server"
      }
    }
  }
}

To Configure using uvx and published package.

{
  "mcpServers": {
    "FutureAGI-MCP": {
      "command": "uvx",
      "args": [
        "futureagi-mcp-server
      ],
      "env": {
        "FI_SECRET_KEY": "your_api_key",
        "FI_API_KEY": "your_secret_key",
      }
    }
  }
}

Project Structure

futureagi-mcp-server/
├── src/                          # Source code directory
│   └──futureagi_mcp_server
│   	├── server.py                 # Main server implementation
│  	├── utils.py                  # Utility functions
│   	├── constants.py              # Constants and configuration
│   	├── logger.py                 # Logging configuration
│   	└── tools/                    # Tools directory
│            ├── evals.py             # Evaluation tools
│            ├── datasets.py          # Dataset tools
│            ├── protect.py           # Protection tools
│            └── routes.py            # Route management
├── tests/                        # Test directory
│   ├── test_dataset.py           # Dataset tests
│   ├── test_protect.py           # Protection tests
│   └── test_evals.py             # Evaluation tests
├── .pre-commit-conifg.yaml       # pre-commit hooks that run before every commit
├── pyproject.toml                # Project configuration and dependencies
├── uv.lock                       # Dependency lock file
├── .gitignore                    # Git ignore rules
└── README.md                     # This file

Contribution are Welcome!

Guidelines for contributing

• Clone the repository either using https or ssh
• Create the venv using uv pip install ".[dev]"
• This will create and install all the required dependencies in a virtual environment
• Ensure to activate the environment
• Make necessary changes and run git commit. It will run the pre-commit hooks. Solve any of the failed checks.