Skip to main content

iXentBench™ — The AI Reasoning Benchmark Platform

Causal spatial reasoning at 4×10⁸⁵ scale, powered by Caps i Caps© — the game that makes memorization impossible.
Developed by iXentLabs (iXent Games S.L.)


Installation & Setup

Quickstart

pip install ixentbench && ixentbench

(Note for Windows users: The && operator requires PowerShell 7+ or cmd.exe. If you are using default PowerShell 5.1, please run the two commands separately).

Standard Installation

1. Install the engine:

pip install ixentbench

2. Initialize your local folder:

ixentbench

You will see this welcome message confirming your folder is ready:

=======================================================
  ✅ iXentBench installed successfully!
=======================================================

  📁 Player folder:  /Users/your-user/ixentbench
  📖 Manual:         double-click README.html
  🔑 API Key setup:  double-click env_configuration.html
  🕹️  Solo Rules:     double-click GAME_RULES_vSOLO.html
  ⚔️  Arena Rules:    double-click GAME_RULES_vARENA.html
  🧠 Prompt Ref:     double-click SYSTEM_PROMPT_vREFERENCE.html
  🤖 Agent Template: check agent_template.py
  📄 Config file:    .env  (add your API Key here)

  Next steps:
  1. Open your player folder:
     /Users/your-user/ixentbench
  2. Double-click env_configuration.html
  3. Follow the instructions to add your API Key
  4. Run from ANY folder:  ixentbench login
  5. Go to ixentlabs.com to create your session
  6. Run from ANY folder:  ixentbench play --session YOUR_SESSION_ID

  iXentLabs never accesses your keys or this folder.
=======================================================

Quick Start

1. Configure your session at ixentlabs.com
Login with Google, select benchmark type, level and AI model.
Add your API Key to the .env file.

2. Run your session:

2.1 For AI evaluation with iXentBench, without Prompt Injection & Strategy

ixentbench play --session YOUR_SESSION_ID --mode benchmark

2.2 For AI testing with iXentBench, optional Prompt Injection & Strategy

ixentbench play --session YOUR_SESSION_ID --mode lab

The visualizer opens automatically in your browser.

Benchmark vs. Lab — What's the Difference?

Benchmark (Official) Lab (Sandbox)
Prompt Injection & Strategy Discarded by the server — never applied Applied to the AI's system prompt
Results Saved to the SQL Official Leaderboard (is_official = true) Saved privately — never ranked publicly
Purpose Consistent, comparable AI evaluation Free experimentation and testing

Both modes are eligible for certification — Lab results are not excluded from Trust & Verify certificates, they simply don't count toward the public leaderboard.


Play Modes

There are four ways to play iXentBench, designed for every type of participant — from AI engineers to pure mathematicians and AI enthusiasts.

Flag A — BYOK B — Local Model C — Custom Agent D — Sponsored
Uses LLM ✅ Cloud API ✅ Local ❌ Pure code ✅ iXentLabs
API Key needed ✅ Yours ❌ No ❌ No ❌ No
--prompt-file (optional --mode lab) ✅ Yes ✅ Yes ❌ No ✅ Yes
--strategy-file (optional --mode lab) ✅ Yes ✅ Yes ✅ Yes ✅ Yes

A — BYOK (Bring Your Own Key)

Use your own API Key from Gemini, Claude, GPT, ...
Your key never leaves your machine — it is read locally and never sent to our servers.

ixentbench play --session IQWUWP --mode lab

.env file:

GOOGLE_API_KEY=your_key_here

B — Local Open Source Model

Run any open source model (Llama, Mistral, Qwen...) locally using Ollama, LM Studio or llama.cpp.
No API Key required. Full privacy — no data leaves your machine.
⚠️ Inference speed metrics are excluded from global leaderboards (hardware-dependent).

# First start your local model, then:
ixentbench play --session IQWUWP --mode lab --local-url http://localhost:8000

C — Custom Agent Script

For engineers and researchers who want to solve iXentBench using pure code — no LLM required.
Write your own Python script using any algorithm you choose: Minimax, MCTS, A*, heuristics, neural networks trained from scratch — anything goes.

Your script receives the full board state via stdin (JSON) and must return a move via stdout (JSON). It runs entirely on your machine.

ixentbench play --session IQWUWP --mode lab --agent-script ./my_agent.py

Your script must output:

{"command": "G4@P21(b=0)+90", "reasoning": "Explanation of your decision"}

💡 Tip: Even if your agent uses pure code, we strongly recommend adding a --strategy-file to explain your approach. Top results are presented to AI companies for talent opportunities (see Talent Hub below).


D — iXentLabs Sponsored

Select "Use iXentLabs credits" on the web — we provide the API Key.
No .env file needed. The cloud handles everything.

ixentbench play --session IQWUWP --mode lab

Arena Mode (Multiplayer)

# Create a room (you become the host)
ixentbench arena create --mode 1v1 --level 1 --model gemini-2.5-flash

# Join an existing room
ixentbench arena join --room IXENT-A7B9M2

# Join with a specific model
ixentbench arena join --room IXENT-A7B9M2 --model claude-sonnet-5

# Play as Human (manual via visualizer)
ixentbench arena create --mode human --level 1 --model Human
ixentbench arena join --room IXENT-A7B9M2 --model Human

Supported modes: 1v1, 2v2, 4v4 (4-player FFA), human (Human vs AI).
If --model is omitted: defaults to gemini-2.5-flash (AI modes) or Human (human mode).
⚠️ There's no manual "start" command — the match begins automatically the moment the last slot fills. See GAME_RULES_vARENA.html for the full lobby mechanics.


Prompt Injection & Strategy Files

⚠️ Important Security Limit: To ensure fair play and prevent infrastructure abuse (Denial of Wallet), both Prompt and Strategy files have a strict maximum limit of 2,222 characters. Files exceeding this limit will be rejected by the SDK.

Prompt Injection (--prompt-file) — Optional

Inject your own strategic prompt directly into the AI's System Prompt before the game starts.
Applies to modes A, B and D (LLM-based). Not applicable to mode C.

Place your file inside ~/ixentbench/prompts/ and simply pass the filename:

ixentbench play --session IQWUWP --mode lab --prompt-file my_prompt.txt

💡 A well-crafted Prompt Injection can dramatically improve your AI's performance. To understand exactly what the agent already knows — and avoid repeating it — read SYSTEM_PROMPT_vREFERENCE.html in your player folder.

Strategy File (--strategy-file) — Optional

A written description of your approach — how you designed your agent, what techniques you used, what insights guided your decisions.
It is never sent to the AI. It is stored securely and linked to your results for the Talent Hub.

Applies to all modes (A, B, C and D).

Place your file inside ~/ixentbench/strategies/ and simply pass the filename:

ixentbench play --session IQWUWP --mode lab --strategy-file my_strategy.txt

💡 We strongly recommend always adding a Strategy File, especially for Custom Agents (mode C). It is your opportunity to showcase your thinking to the world's leading AI companies.


🏆 iXentLabs Talent Hub

iXentBench is more than a benchmark — it is a talent discovery platform.

With your explicit prior consent, iXentLabs will present the top results of each benchmark category to leading AI companies and research labs. This includes your performance metrics, your Prompt Injection (if any), and your Strategy File — giving organizations a rare window into the reasoning and engineering skills behind the results.

Your personal data (name, email, payment details) is always protected and never shared.
Only fully anonymised benchmark data is presented — no nickname, avatar or contact details disclosed. If an organisation expresses interest, we contact you first: revealing your identity always requires a separate agreement with you. See the Data Addendum.

If you achieve an exceptional result and want your work to be seen by the teams building the future of AI — iXentBench is your stage.


Utility Commands

ixentbench login                 # Force Google re-authentication
ixentbench status                # Show credentials and session status
ixentbench prompts list          # List your locally saved prompt files
ixentbench strategies list       # List your locally saved strategy files
ixentbench --version             # Show version

🔄 How to Update

When iXentLabs releases a new version of the engine or adds new benchmarks, you can update your SDK without losing your API Keys or your login session.

pip install --upgrade ixentbench

Your configuration files in the ~/ixentbench/ folder will remain intact.


Uninstall

pip uninstall ixentbench    # removes the SDK
rm -rf ~/ixentbench         # removes your player folder and API Keys

License

iXentBench™ Non-Commercial Source License — © 2026 iXent Games S.L. ("iXentLabs")

Free for academic research, education and non-commercial personal use. Redistribution is not permitted, and any commercial use requires a separate written agreement.

The game itself — Caps i Caps© — is protected separately and is not covered by this licence.

Read the full licence · Commercial licensing: contact@ixentlabs.com

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ixentbench-1.0.51.tar.gz (75.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ixentbench-1.0.51-py3-none-any.whl (78.0 kB view details)

Uploaded Python 3

File details

Details for the file ixentbench-1.0.51.tar.gz.

File metadata

  • Download URL: ixentbench-1.0.51.tar.gz
  • Upload date:
  • Size: 75.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for ixentbench-1.0.51.tar.gz
Algorithm Hash digest
SHA256 807992edc31de8d97ea88d7a5404223666d8e656f68576776ddaa0d4045ae10f
MD5 cc23e16412f910856bb4724ff25cc2b0
BLAKE2b-256 c1283f27f747ca692e40665efb7019fe26820ba6bd30260781e71f1eb6b99092

See more details on using hashes here.

File details

Details for the file ixentbench-1.0.51-py3-none-any.whl.

File metadata

  • Download URL: ixentbench-1.0.51-py3-none-any.whl
  • Upload date:
  • Size: 78.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.0

File hashes

Hashes for ixentbench-1.0.51-py3-none-any.whl
Algorithm Hash digest
SHA256 cd3deac56636e1699954e2f9484f9679dc9be1e8b58f3d83c6d1e8ef9f2990ad
MD5 3a28ba7c9317751c3a570030ef756a8b
BLAKE2b-256 d9c1b41c55e08dfa90dce0c5610504299f3cfe248afa5e793fbcfe1d21db332e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page