Text based Puzzle Generators for AI Research
This repository contains functions for generating puzzles composed of blocks of English text or ASCII based diagrams.
There is a command line application for interacting with the puzzle generators as well as a library that can be used to incorporate these puzzles in your application of model testing framework.
The puzzles are generated randomly from predetermined distributions. Each of the generators is designed to use text to create higher level representations of a puzzle domain that requires the development of spontaneous mental models in order to manipulate cognitively to reason about and solve the problems.
Some CLI parameters allow for generating from restricted complexty sets. These are used when experimenting with complexity thresholds that affect both human and machine performance on these tasks.
Usage
Citations
This package is being presented at the ICEAST conference in May 2025
@article{hawkins:2025,
author = {John Hawkins},
title = {Enigme: Generative Text Puzzles for Evaluating Reasoning in Language Models}
booktitle = {2025 11th International Conference on Engineering, Applied Sciences, and Technology (ICEAST)}
year = {2025},
month = {05},
}
Additional work on analysis to follow, watch this space.
Release files for enigme 0.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| enigme-0.0.0.tar.gz | 65.8 kB | Details |
Release files / enigme-0.0.0.tar.gz
| Download URL | enigme-0.0.0.tar.gz |
|---|---|
| Size | 65.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f7a5f56439c188d39da6fed403fd67b77f25df0098c8b5606743d6ea59cef5f8
|
|
BLAKE2b-256 checksum How to use checksums |
bf6e8135becaa7642eda59e5a730ffd257fb9ee37460a87c828e65ffc344f4e7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.10.8
|