Skip to main content

A MCP server that uses Groq's API to call LLMs which expose raw chain-of-thought tokens.

Project description

Chain of Thought MCP Server

Anthropic's recent article "The "think" tool: Enabling Claude to stop and think in complex tool use situations" shows that using an external think tool notably increases performance on SWE Bench.

This MCP Server uses Groq's API to call LLMs which expose raw chain-of-thought tokens from Qwen's qwq model.

Installation

  1. Clone this repository to your local machine.
  2. Run uv sync to install depencies
  3. Get a Groq API key from here.
  4. Update your mcp configuration with:
"mcpServers": {
  "chain_of_thought": {
    "command": "uv",
    "args": [
        "--directory",
        "path/to/cot-mcp-server",
        "run",
        "src/server.py"
      ],
      "env": {
        "GROQ_API_KEY": "your-groq-api-key"
      }
    }
}

The path should be the local path to this repository. You can get this easily by running pwd in the terminal from the root of the repository.

Instructing The AI To Use This MCP Server

I personally prefer the agent call this tool on every request to increase performance. I add this to my rules for the agent:

<IMPORTANT>
<when_to_use_tool>
You should call the mcp chain_of_thought tool every time you talk to the user, which generates a chain-of-thought stream which you will use to complete the user's request.
</when_to_use_tool>

Before taking any action or responding to the user use the chain of thought tool as a scratchpad to:
- List the specific rules that apply to the current request
- Check if all required information is collected
- Verify that the planned action complies with all policies
- Iterate over tool results for correctness 

Here are some examples of what to iterate over inside the think tool:
<cot_tool_example_1>
User wants to cancel flight ABC123
- Need to verify: user ID, reservation ID, reason
- Check cancellation rules:
  * Is it within 24h of booking?
  * If not, check ticket class and insurance
- Verify no segments flown or are in the past
- Plan: collect missing info, verify rules, get confirmation
</cot_tool_example_1>

<cot_tool_example_2>
User wants to book 3 tickets to NYC with 2 checked bags each
- Need user ID to check:
  * Membership tier for baggage allowance
  * Which payments methods exist in profile
- Baggage calculation:
  * Economy class × 3 passengers
  * If regular member: 1 free bag each  3 extra bags = $150
  * If silver member: 2 free bags each  0 extra bags = $0
  * If gold member: 3 free bags each  0 extra bags = $0
- Payment rules to verify:
  * Max 1 travel certificate, 1 credit card, 3 gift cards
  * All payment methods must be in profile
  * Travel certificate remainder goes to waste
- Plan:
1. Get user ID
2. Verify membership level for bag fees
3. Check which payment methods in profile and if their combination is allowed
4. Calculate total: ticket price + any bag fees
5. Get explicit confirmation for booking
</cot_tool_example_2>

</IMPORTANT>

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0.tar.gz.

File metadata

  • Download URL: iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0.tar.gz
  • Upload date:
  • Size: 13.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0.tar.gz
Algorithm Hash digest
SHA256 22187c80008a626975a00c28186dcc168144fa1299970ff2543755b4c851a010
MD5 7b640624403670edbcab5bbfafcab9b3
BLAKE2b-256 d01a3acf8739d48dea698cb9ff9dbbbb955b540f915622fca1b3b482180e0113

See more details on using hashes here.

File details

Details for the file iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 14.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Debian GNU/Linux","version":"13","id":"trixie","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for iflow_mcp_beverm2391_chain_of_thought_mcp-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c15581b8fa0b3e8b836dc2526f09f438d453b96672bf7d95bc5d58dc4e3744a4
MD5 096edd5c0d7f41e44d90a3a99e3e64e6
BLAKE2b-256 42f3c0d58e2ecfc0a645ebfef6ba794e6baf8597db334833da83a32a535109b1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page