Skip to main content

iXentBench™ — The AI Reasoning Benchmark Platform

Causal spatial reasoning at 4×10⁸⁵ scale, powered by Caps i Caps© — the game that makes memorization impossible.
Developed by iXentLabs (iXent Games S.L.)


Installation & Setup

Quickstart

pip install ixentbench && ixentbench

(Note for Windows users: The && operator requires PowerShell 7+ or cmd.exe. If you are using default PowerShell 5.1, please run the two commands separately).

Standard Installation

1. Install the engine:

pip install ixentbench

2. Initialize your local folder:

ixentbench

You will see this welcome message confirming your folder is ready:

=======================================================
  ✅ iXentBench installed successfully!
=======================================================

  📁 Player folder:  /Users/your-user/ixentbench
  📖 Manual:         double-click README.html
  🔑 API Key setup:  double-click env_configuration.html
  🕹️  Solo Rules:     double-click GAME_RULES_vSOLO.html
  ⚔️  Arena Rules:    double-click GAME_RULES_vARENA.html
  🧠 Prompt Ref:     double-click SYSTEM_PROMPT_vREFERENCE.html
  🤖 Agent Template: check agent_template.py
  📄 Config file:    .env  (add your API Key here)

  Next steps:
  1. Open your player folder:
     /Users/your-user/ixentbench
  2. Double-click env_configuration.html
  3. Follow the instructions to add your API Key
  4. Run from ANY folder:  ixentbench login
  5. Go to ixentlabs.com to create your session
  6. Run from ANY folder:  ixentbench play --session YOUR_SESSION_ID

  iXentLabs never accesses your keys or this folder.
=======================================================

Quick Start

1. Configure your session at ixentlabs.com
Login with Google, select benchmark type, level and AI model.
Add your API Key to the .env file.

2. Run your session:

2.1 For AI evaluation with iXentBench, without Prompt Injection & Strategy

ixentbench play --session YOUR_SESSION_ID --mode benchmark

2.2 For AI testing with iXentBench, optional Prompt Injection & Strategy

ixentbench play --session YOUR_SESSION_ID --mode lab

The visualizer opens automatically in your browser.

Benchmark vs. Lab — What's the Difference?

Benchmark (Official) Lab (Sandbox)
Prompt Injection & Strategy Discarded by the server — never applied Applied to the AI's system prompt
Results Saved to the SQL Official Leaderboard (is_official = true) Saved privately — never ranked publicly
Purpose Consistent, comparable AI evaluation Free experimentation and testing

Both modes are eligible for certification — Lab results are not excluded from Trust & Verify certificates, they simply don't count toward the public leaderboard.


Play Modes

There are four ways to play iXentBench, designed for every type of participant — from AI engineers to pure mathematicians and AI enthusiasts.

Flag A — BYOK B — Local Model C — Custom Agent D — Sponsored
Uses LLM ✅ Cloud API ✅ Local ❌ Pure code ✅ iXentLabs
API Key needed ✅ Yours ❌ No ❌ No ❌ No
--prompt-file (optional --mode lab) ✅ Yes ✅ Yes ❌ No ✅ Yes
--strategy-file (optional --mode lab) ✅ Yes ✅ Yes ✅ Yes ✅ Yes

A — BYOK (Bring Your Own Key)

Use your own API Key from Gemini, Claude, GPT, ...
Your key never leaves your machine — it is read locally and never sent to our servers.

ixentbench play --session IQWUWP --mode lab

.env file:

GOOGLE_API_KEY=your_key_here

B — Local Open Source Model

Run any open source model (Llama, Mistral, Qwen...) locally using Ollama, LM Studio or llama.cpp.
No API Key required. Full privacy — no data leaves your machine.
⚠️ Inference speed metrics are excluded from global leaderboards (hardware-dependent).

# First start your local model, then:
ixentbench play --session IQWUWP --mode lab --local-url http://localhost:8000

C — Custom Agent Script

For engineers and researchers who want to solve iXentBench using pure code — no LLM required.
Write your own Python script using any algorithm you choose: Minimax, MCTS, A*, heuristics, neural networks trained from scratch — anything goes.

Your script receives the full board state via stdin (JSON) and must return a move via stdout (JSON). It runs entirely on your machine.

ixentbench play --session IQWUWP --mode lab --agent-script ./my_agent.py

Your script must output:

{"command": "G4@P21(b=0)+90", "reasoning": "Explanation of your decision"}

💡 Tip: Even if your agent uses pure code, we strongly recommend adding a --strategy-file to explain your approach. Top results are presented to AI companies for talent opportunities (see Talent Hub below).


D — iXentLabs Sponsored

Select "Use iXentLabs credits" on the web — we provide the API Key.
No .env file needed. The cloud handles everything.

ixentbench play --session IQWUWP --mode lab

Arena Mode (Multiplayer)

# Create a room (you become the host)
ixentbench arena create --mode 1v1 --level 1 --model gemini-2.5-flash

# Join an existing room
ixentbench arena join --room IXENT-A7B9M2

# Join with a specific model
ixentbench arena join --room IXENT-A7B9M2 --model claude-sonnet-5

# Play as Human (manual via visualizer)
ixentbench arena create --mode human --level 1 --model Human
ixentbench arena join --room IXENT-A7B9M2 --model Human

Supported modes: 1v1, 2v2, 4v4 (4-player FFA), human (Human vs AI).
If --model is omitted: defaults to gemini-2.5-flash (AI modes) or Human (human mode).
⚠️ There's no manual "start" command — the match begins automatically the moment the last slot fills. See GAME_RULES_vARENA.html for the full lobby mechanics.


Prompt Injection & Strategy Files

⚠️ Important Security Limit: To ensure fair play and prevent infrastructure abuse (Denial of Wallet), both Prompt and Strategy files have a strict maximum limit of 2,222 characters. Files exceeding this limit will be rejected by the SDK.

Prompt Injection (--prompt-file) — Optional

Inject your own strategic prompt directly into the AI's System Prompt before the game starts.
Applies to modes A, B and D (LLM-based). Not applicable to mode C.

Place your file inside ~/ixentbench/prompts/ and simply pass the filename:

ixentbench play --session IQWUWP --mode lab --prompt-file my_prompt.txt

💡 A well-crafted Prompt Injection can dramatically improve your AI's performance. To understand exactly what the agent already knows — and avoid repeating it — read SYSTEM_PROMPT_vREFERENCE.html in your player folder.

Strategy File (--strategy-file) — Optional

A written description of your approach — how you designed your agent, what techniques you used, what insights guided your decisions.
It is never sent to the AI. It is stored securely and linked to your results for the Talent Hub.

Applies to all modes (A, B, C and D).

Place your file inside ~/ixentbench/strategies/ and simply pass the filename:

ixentbench play --session IQWUWP --mode lab --strategy-file my_strategy.txt

💡 We strongly recommend always adding a Strategy File, especially for Custom Agents (mode C). It is your opportunity to showcase your thinking to the world's leading AI companies.


🏆 iXentLabs Talent Hub

iXentBench is more than a benchmark — it is a talent discovery platform.

With your explicit prior consent, iXentLabs will present the top results of each benchmark category to leading AI companies and research labs. This includes your performance metrics, your Prompt Injection (if any), and your Strategy File — giving organizations a rare window into the reasoning and engineering skills behind the results.

Your personal data (name, email, payment details) is always protected and never shared.
Only fully anonymised benchmark data is presented — no nickname, avatar or contact details disclosed. If an organisation expresses interest, we contact you first: revealing your identity always requires a separate agreement with you. See the Data Addendum.

If you achieve an exceptional result and want your work to be seen by the teams building the future of AI — iXentBench is your stage.


Utility Commands

ixentbench login                 # Force Google re-authentication
ixentbench status                # Show credentials and session status
ixentbench prompts list          # List your locally saved prompt files
ixentbench strategies list       # List your locally saved strategy files
ixentbench --version             # Show version

🔄 How to Update

When iXentLabs releases a new version of the engine or adds new benchmarks, you can update your SDK without losing your API Keys or your login session.

pip install --upgrade ixentbench

Your configuration files in the ~/ixentbench/ folder will remain intact.


Uninstall

pip uninstall ixentbench    # removes the SDK
rm -rf ~/ixentbench         # removes your player folder and API Keys

License

iXentBench™ Non-Commercial Source License — © 2026 iXent Games S.L. ("iXentLabs")

Free for academic research, education and non-commercial personal use. Redistribution is not permitted, and any commercial use requires a separate written agreement.

The game itself — Caps i Caps© — is protected separately and is not covered by this licence.

Read the full licence · Commercial licensing: contact@ixentlabs.com

Metadata

Release files for ixentbench 1.0.58

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for ixentbench 1.0.58
File Size Uploaded
ixentbench-1.0.58.tar.gz 77.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for ixentbench 1.0.58
File Interpreter ABI Platform
ixentbench-1.0.58-py3-none-any.whl Python 3 none any Details

Total release size: 156.1 kB

Release files / ixentbench-1.0.58.tar.gz

Download URL ixentbench-1.0.58.tar.gz
Size 77.1 kB
Tags Source
SHA-256 checksum
How to use checksums
cde119cb225569539b350eb4c469cd49043a010fc2f4dd5dfa71b681df18d354
BLAKE2b-256 checksum
How to use checksums
fb6db3191017acfd4b3c2ca14e0aae0619415b4f7c39628a920c34cc1a898abf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Release files / ixentbench-1.0.58-py3-none-any.whl

Download URL ixentbench-1.0.58-py3-none-any.whl
Size 79.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8c1a5ef550d4d8fcbe4066eaeaae4af01728b4a3e2f48a497c5d9cdb50782580
BLAKE2b-256 checksum
How to use checksums
aa759bbc5e14f71601cdced7213ed90cc585c4b77057177db75350ca7e237d7f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.14.0

Release history Release notifications | RSS feed

1.0.60

2 release files

1.0.59

2 release files

This release

1.0.58 This release

2 release files

1.0.57

2 release files

1.0.54

2 release files

1.0.47

2 release files

1.0.46

2 release files

1.0.45

2 release files

1.0.44

2 release files

1.0.43

2 release files

1.0.42

2 release files

1.0.36

2 release files

1.0.35

2 release files

1.0.34

2 release files

1.0.33

2 release files

1.0.32

2 release files

1.0.31

2 release files

1.0.30

2 release files

1.0.29

2 release files

1.0.28

2 release files

1.0.27

2 release files

1.0.26

2 release files

1.0.25

2 release files

1.0.23

2 release files

1.0.22

2 release files

1.0.21

2 release files

1.0.20

2 release files

1.0.19

2 release files

1.0.17

2 release files

1.0.16

2 release files

1.0.15

2 release files

1.0.14

2 release files

1.0.13

2 release files

1.0.12

2 release files

1.0.11

2 release files

1.0.10

2 release files

1.0.9

2 release files

1.0.8

2 release files

1.0.7

2 release files

1.0.6

2 release files

1.0.5

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page