miskeyed-xr-agent

miskeyed-xr-agent is a small C++20 investigation into turning human XR input into deterministic, host-neutral spatial intent. OpenXR is an input backend, not the public data model. The project deliberately contains no renderer, scene graph, USD/Workbench/Kit dependency, network service, speech recognizer, computer vision system, or AI model.

Milestone 1

The first milestone provides:

host-neutral poses, rays, semantic pointing, capability snapshots, and intent frames;
a Khronos OpenXR 1.1 loader probe that enumerates runtime capabilities and creates select, aim_pose, and grip_pose semantic actions;
a host-owned-session OpenXR sampler that synchronizes semantic aim actions and locates head/aim poses at one XrTime;
a versioned JSONL recording draft and hardware-free tests; and
a bounded timeline that turns sparse final text into one spatially grounded event instead of repeating text on realtime frames; and
a documented boundary between portable XR input and host-owned scene queries.

If you are building miskeyed-xr-agent-usd or an Omniverse Kit extension, start with the concrete host integration pass. The included spatial-host-example proves the consumer path without OpenXR or headset hardware: intent ray in, host raycast, grounded intent out.

Python and agent-framework consumers can install the pybind11 package with python -m pip install miskeyed-xr-agent and import it as miskeyed.xr.agent. See the Python agent workflow for the intended USD-agent handoff and the reason an agent receives a plain, already-grounded dictionary instead of raw OpenXR objects.

Native embedders should read the OpenXR implementation contract. The separate Omniverse test app must reuse Kit's OpenXR lifecycle rather than create a competing XR session; no Kit extension code is shipped from this core. The CI/release contract describes the hardware-free gate and version-first, multi-platform TestPyPI/PyPI deployment. The realtime digital-twin vision explains how XR feedback, sparse language, live twin telemetry, simulation, and reviewed scene changes fit together—and lists what remains unimplemented. The milestone exit contract is the handoff checklist for the separate Omniverse application. The Kit app learning path provides a staged, version-conscious plan for that repository without adding Kit SDK ownership or dependencies here.

Normalized recordings are available after installation:

xr-agent-record session.jsonl < normalized-stream.jsonl
xr-agent-replay session.jsonl --speed 1

The command-line probe does not invent a headless session. A normal OpenXR session needs a platform graphics binding. The probe performs discovery without one, and reports that an embedding graphics host is required before live action synchronization and xrLocateViews/xrLocateSpace sampling. This keeps the prototype truthful and renderer-neutral.

Build

cmake -S . -B build
cmake --build build
ctest --test-dir build --output-on-failure
./build/xr-agent-probe

CMake first looks for an installed OpenXR::openxr_loader. By default it otherwise fetches the pinned official Khronos SDK source release. Use -DMISKEYED_XR_BUILD_OPENXR=OFF -DMISKEYED_XR_FETCH_OPENXR=OFF for a completely offline, core-only build.

Current answer

OpenXR 1.1 is a good portable runtime, tracking, and semantic action foundation. Head/view poses, reference spaces, action sets, pose actions, and extension discovery are core. Hand joints, hand-interaction bindings, and eye gaze are optional extensions and must remain optional. Scene meshes, depth, raycasts, passthrough/camera pixels, durable anchors, text, and voice are not one uniform core capability; the host or explicit adapters own those areas. See the capability matrix and architecture decisions.

Privacy

Eye gaze is opt-in. Capability detection is not consent, and raw gaze history must not be recorded by default.

Licensed under the MIT License.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

miskeyed_xr_agent-0.1.0.tar.gz (42.0 kB view details)

Uploaded Aug 23, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

miskeyed_xr_agent-0.1.0-cp314-cp314-win_amd64.whl (151.4 kB view details)

Uploaded Aug 23, 2026 CPython 3.14Windows x86-64

miskeyed_xr_agent-0.1.0-cp314-cp314-win32.whl (134.2 kB view details)

Uploaded Aug 23, 2026 CPython 3.14Windows x86

miskeyed_xr_agent-0.1.0-cp314-cp314-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded Aug 23, 2026 CPython 3.14musllinux: musl 1.2+ x86-64

miskeyed_xr_agent-0.1.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (206.7 kB view details)

Uploaded Aug 23, 2026 CPython 3.14manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

miskeyed_xr_agent-0.1.0-cp314-cp314-macosx_11_0_arm64.whl (158.4 kB view details)

Uploaded Aug 23, 2026 CPython 3.14macOS 11.0+ ARM64

miskeyed_xr_agent-0.1.0-cp313-cp313-win_amd64.whl (146.6 kB view details)

Uploaded Aug 23, 2026 CPython 3.13Windows x86-64

miskeyed_xr_agent-0.1.0-cp313-cp313-win32.whl (130.7 kB view details)

Uploaded Aug 23, 2026 CPython 3.13Windows x86

miskeyed_xr_agent-0.1.0-cp313-cp313-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded Aug 23, 2026 CPython 3.13musllinux: musl 1.2+ x86-64

miskeyed_xr_agent-0.1.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (206.5 kB view details)

Uploaded Aug 23, 2026 CPython 3.13manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

miskeyed_xr_agent-0.1.0-cp313-cp313-macosx_11_0_arm64.whl (157.8 kB view details)

Uploaded Aug 23, 2026 CPython 3.13macOS 11.0+ ARM64

miskeyed_xr_agent-0.1.0-cp312-cp312-win_amd64.whl (146.7 kB view details)

Uploaded Aug 23, 2026 CPython 3.12Windows x86-64

miskeyed_xr_agent-0.1.0-cp312-cp312-win32.whl (130.7 kB view details)

Uploaded Aug 23, 2026 CPython 3.12Windows x86

miskeyed_xr_agent-0.1.0-cp312-cp312-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded Aug 23, 2026 CPython 3.12musllinux: musl 1.2+ x86-64

miskeyed_xr_agent-0.1.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (206.0 kB view details)

Uploaded Aug 23, 2026 CPython 3.12manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

miskeyed_xr_agent-0.1.0-cp312-cp312-macosx_11_0_arm64.whl (157.8 kB view details)

Uploaded Aug 23, 2026 CPython 3.12macOS 11.0+ ARM64

miskeyed_xr_agent-0.1.0-cp311-cp311-win_amd64.whl (146.3 kB view details)

Uploaded Aug 23, 2026 CPython 3.11Windows x86-64

miskeyed_xr_agent-0.1.0-cp311-cp311-win32.whl (129.9 kB view details)

Uploaded Aug 23, 2026 CPython 3.11Windows x86

miskeyed_xr_agent-0.1.0-cp311-cp311-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded Aug 23, 2026 CPython 3.11musllinux: musl 1.2+ x86-64

miskeyed_xr_agent-0.1.0-cp311-cp311-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (204.2 kB view details)

Uploaded Aug 23, 2026 CPython 3.11manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

miskeyed_xr_agent-0.1.0-cp311-cp311-macosx_11_0_arm64.whl (157.0 kB view details)

Uploaded Aug 23, 2026 CPython 3.11macOS 11.0+ ARM64

miskeyed_xr_agent-0.1.0-cp310-cp310-win_amd64.whl (145.4 kB view details)

Uploaded Aug 23, 2026 CPython 3.10Windows x86-64

miskeyed_xr_agent-0.1.0-cp310-cp310-win32.whl (129.1 kB view details)

Uploaded Aug 23, 2026 CPython 3.10Windows x86

miskeyed_xr_agent-0.1.0-cp310-cp310-musllinux_1_2_x86_64.whl (1.2 MB view details)

Uploaded Aug 23, 2026 CPython 3.10musllinux: musl 1.2+ x86-64

miskeyed_xr_agent-0.1.0-cp310-cp310-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (203.5 kB view details)

Uploaded Aug 23, 2026 CPython 3.10manylinux: glibc 2.27+ x86-64manylinux: glibc 2.28+ x86-64

miskeyed_xr_agent-0.1.0-cp310-cp310-macosx_11_0_arm64.whl (155.9 kB view details)

Uploaded Aug 23, 2026 CPython 3.10macOS 11.0+ ARM64

File details

Details for the file miskeyed_xr_agent-0.1.0.tar.gz.

File metadata

Download URL: miskeyed_xr_agent-0.1.0.tar.gz
Upload date: Aug 23, 2026
Size: 42.0 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for miskeyed_xr_agent-0.1.0.tar.gz
Algorithm	Hash digest
SHA256	`030835c58a16581251f5216223e94d5856031ee35b9e8129b216ed12e276d909`
MD5	`ff44ce6f4a455079980957eabbcd010b`
BLAKE2b-256	`5617eeb54abd0d1d99ddf42379fc1fc31bdf04e4d2f5810597f221ede642f763`

Algorithm	Hash digest
SHA256	`7d5da40a43b6e1572c7046f6e00be81dba7d12576a746980f344d6d133ead1d0`
MD5	`2f232c86d8ad383bad30cfb1382956fc`
BLAKE2b-256	`331b780829050fea49f5ba91e232534a29ca5fef278e5435a634b4c3c5da2909`

Algorithm	Hash digest
SHA256	`25d12acc2aebf192b2b2672bd407aa20a0688578a68b490dae736495ce1a06b5`
MD5	`e55c9b48a98310fea060bae0e9a8fd27`
BLAKE2b-256	`9ea5d46fdec8447a8a5cc587516f89221c7a9cc40bccafc5a592c379c80d3dff`

Algorithm	Hash digest
SHA256	`dd6481767112a35d1d770af78a1add3535284ad69d12e6f54827b65a6ec75a9c`
MD5	`6967acbc7473969089299b54b88d22ba`
BLAKE2b-256	`f7e8c9af22f73353545a97dacc87e424630c9f9cfcb68a227ef7900fc4fbf090`

Algorithm	Hash digest
SHA256	`e533b080cd2fc6c1a2c5be2d6b8637d3a71275afa336205a952976af67d6f543`
MD5	`3d224cb4a9ed8bc2b3faa9de5d080b8d`
BLAKE2b-256	`efe9ee4b1c995e98e64388264d3fa8879bb3f1a5760185d3699109cdae1d9cdf`

Algorithm	Hash digest
SHA256	`641a546d445ba820556442b0ce7b6c801959c0072931f414a122f07daf72572b`
MD5	`0fc485a7a94b02e77967d4a0e2a558c4`
BLAKE2b-256	`8f7bb0dfb6d05b5d1d153e89303f6cb69ef259114684208b98ec2a4b9c3710a6`

Algorithm	Hash digest
SHA256	`3c700c0c148fcea443471be8610c345d42f43d4b70901ee949954bee4c4a42e5`
MD5	`ede177cd5779c764ded2b2ddb457e506`
BLAKE2b-256	`bc6fd9055e5d20b257395200259b3e1ef4fd9c0c78188b6c7bac6b0474c4272f`

Algorithm	Hash digest
SHA256	`3bbc96220f5f29aa155d7f6b84a738f6e48edaad12b6e18fab7d4804fbbca6ab`
MD5	`240be9a7a368c5b935fc74db342483e8`
BLAKE2b-256	`1a7569df2d9bec4a0583640014ce5d81a99ccb4046afb3a90742ebd6a0ed8d9f`

Algorithm	Hash digest
SHA256	`852344c6403066d4c0d70852d0676d6468d01693a4a8cee973d61e0e1d963166`
MD5	`c6bdea8eb4f63d534271988963d96670`
BLAKE2b-256	`41a0a8259c96e5f3015658368089fbdc3ac77b583f960f5790e87730d5a1785c`

Algorithm	Hash digest
SHA256	`f6fd0250691fcd2726f30a0e9a18fcb9e009ad5500b5acaefccb66ec8f58da84`
MD5	`664d3b75d4eabad0ef7cc90c0950d8db`
BLAKE2b-256	`017dfe4592cd6b132cd49179de6851bffe48f7d02f3e0002c7239d2604137370`

Algorithm	Hash digest
SHA256	`24aaf01e851bf15671a8c40841f2386fec0a98543b501609d8977894f21dcc43`
MD5	`cd206220721df5e99049333f6c2a4460`
BLAKE2b-256	`35af0cdb09ed8ae3206299a27dac61a40301426070c9494bf9052e1c596aa41f`

Algorithm	Hash digest
SHA256	`a3973780cac7cb05750f6fd792f5e6e6fb6c8bdde323c17883cf2d057e2b14c9`
MD5	`739d1268c2bf47b7b62f484dd27e6431`
BLAKE2b-256	`1d9caebd4bf0493518bab308bea78ed99a167d18b80a2e88f224ededa059b4b5`

Algorithm	Hash digest
SHA256	`fad0b8c15a34b99c3fcadd2006ab5044262db0c0dd06a2e5577194e8ec1a30ed`
MD5	`25343174e90a3673ac7771ba0d83eaa7`
BLAKE2b-256	`dbaf95f518d702f670cb46fadc43ecfc4388251d3b0eb140acfca256b89d7fc9`

Algorithm	Hash digest
SHA256	`19ddee9890be08021e0f8213126c46eece00f5403899516c7705f5158a92c663`
MD5	`9af39da21ba2826bc12e577952cd828e`
BLAKE2b-256	`2aed147255f87c13d7c606c5dd1de4a543505aa15ca1e206a255b3832cd53699`

Algorithm	Hash digest
SHA256	`d1d685c4bdc68b046c59c0f7568144f30b35cee1f52760dec2ea79a9cb9ab15c`
MD5	`7a3cd6bff1c469ed18e731a4ab11b3cb`
BLAKE2b-256	`06c3e2b0082dd26af412708a22123c03749e1fbc1f5ae2df15c2816769e99fa5`

Algorithm	Hash digest
SHA256	`da97e88cea9203a44ec7a130f7797344c223d9da4a6dd95d3d5262d6a9d5b24b`
MD5	`7fdc1a155ec54228549287c94ca4e00f`
BLAKE2b-256	`3c88510353f7e99c08c0cc521579c331fe27a02e4ea3b38d071985229ce919b6`

Algorithm	Hash digest
SHA256	`76b5fa25079a3c4cef56d97261ed8b91ab48b74d6203ba712c28df5ba4e6668d`
MD5	`34d23d60c8b0a9e3a16f723390138e35`
BLAKE2b-256	`1a2b9ae90daf2f04ef9ace5ffaa4c4ff5aac0968346afd7adabb749ab2f5d448`

Algorithm	Hash digest
SHA256	`4c8ae272e5555183584767e054d40d71b2fa19dc4990b65bcf308e724ec1cf41`
MD5	`09fcc67bc587e6af8d0671c2879a83d0`
BLAKE2b-256	`b96486156a7e08cd6f4b362d14549306dc6d08fc1e82a552631d71f8a76df13b`

Algorithm	Hash digest
SHA256	`720c14c4c49e0a43f62629e6b561c334429d2818782f93f00420b519cf19ffb0`
MD5	`2718f43c7931575b5642f55067e46220`
BLAKE2b-256	`22bfa625e97bde9dd529815a30edc541a655262aa19ef7609bb2566e2fa9cfa3`

Algorithm	Hash digest
SHA256	`832a1d53c0880d9d21869b1f2cfad97b0d93b1c7753005358b589ac4f305c1df`
MD5	`383a2c1c31b2f67d4fc1a5205c87fe2d`
BLAKE2b-256	`0a04c12cd61d90c16612905bbeb112dc310276d00b6d3f7e8ef01f0c4051453c`

Algorithm	Hash digest
SHA256	`2958848292b17a105ae4afc13a2ef38675747d31e6554de08ec1dd7999bf1887`
MD5	`ae1c30ad5e66ce4217887d6fdade75d9`
BLAKE2b-256	`e060d449380898ea68a35b3ff1741031d796ef07b45c2175da47a91eff898864`

miskeyed-xr-agent 0.1.0

miskeyed-xr-agent

Milestone 1

Build

Current answer

Privacy

Project links

Key dates

1 maintainer

Credits

GitHub Statistics

License expression

Requires

Tags

Classifiers

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

File hashes

Provenance

File details

File metadata

Algorithm	Hash digest
SHA256	`dc35480d53479595b2c086fb3937d92e682b55d40f10010283c015a8443ed606`
MD5	`9315b9292e6c213d11ecf6d531f56543`
BLAKE2b-256	`db5c16de90e524a19f54e1885bce4723c159f339b8db62daa457ae75c9777bb3`

Algorithm	Hash digest
SHA256	`c1e21cc737c13a267d76d9b5f88b416f7b1d7bf3e6626a1292aa85b9f83714ef`
MD5	`dde4f07392d7b0b01a10d23d3289e3b8`
BLAKE2b-256	`b93a954aa0857f40549a0f7bcc2f9a0403d7df41a9d21e229bae1feb713c0917`

Algorithm	Hash digest
SHA256	`e7b2b22c7f97fd6fddb94b2daedb0d5cfb807698ea3ee8008bcda8b6b0f70253`
MD5	`2f223105eba08478ce97191c7703953e`
BLAKE2b-256	`bdaa78134e18c49b36bd1a829d7ac930c2c3fdb489632df2c037077dcc51842b`

Algorithm	Hash digest
SHA256	`cfa2204651356ab9e7b3ab79410c4e0e84522f24f510ea5a1acfb2d94871f746`
MD5	`d45f4be79aef9156401b0e15d9679d34`
BLAKE2b-256	`3adb87d800a871d603d54deb97d571694e93dd48ca22c91cfdf5e40b0f26a70b`

Algorithm	Hash digest
SHA256	`cb85a1bdc3af579ce64b3e75be3b1a8a8c1b3ea36701580e1acc2c5a11616ac3`
MD5	`63bf6e92a5f6277403c57d01a65a70ff`
BLAKE2b-256	`b833c8a21c9e5686ff491634a8e0114a6148c28e36b8a89699a8e1c3a9af63e6`