Skip to main content

TileOPs × TileFoundry — From Kernels to a Library: By Agents, for Agents

Spec-driven LLM operators across backends — by agents, for agents

TileOPs defines what each operator must do.
Coding agents and TileFoundry, an AI compiler built for agents, iterate to grow the library.

PyPI version Spec coverage Bench coverage Rows ahead of or level with the fastest baseline, from the latest nightly Kernels forged by TileFoundry

Quick Start · Benchmarks · Docs · TileFoundry


Agent and compiler, working together

TileOPs
agents answer to specs
TileFoundry
the compiler answers to agents
Each op starts with a YAML spec. Tests and benchmarks use the reference implementation, workloads and roofline formula declared in the spec to check correctness and measure performance. A tile-based AI compiler that coding agents use to generate high-performance programs across hardware platforms.

TileOPs shows how a coding agent and TileFoundry can work together in a loop to build an operator library. Tests and benchmarks driven by each op's spec report failures and the gap to the roofline bound. The agent and compiler iterate on that feedback. Kernels that pass the checks become part of the library, where later work can build on them. This approach supports a growing, maintainable library rather than a few one-off kernels.

spec ──▶ coding agent ◀──▶ TileFoundry ──▶ kernel
              ▲            (AI compiler)     │
              │                              ▼
              └─ failures, roofline gap ◀── tests + benchmarks
                                             │ pass
                                             ▼
                                      TileOPs library

PRs whose kernels were generated with TileFoundry carry the foundry label. The badge above counts merged PRs with this label. These PRs go through the same CI as every other PR.

Quick Start

import torch
from tileops.gemm import GEMMFwdOp

gemm = GEMMFwdOp()  # shapes and dtype are inferred at call time

a = torch.randn(1024, 512, device="cuda", dtype=torch.float16)
b = torch.randn(1024, 512, device="cuda", dtype=torch.float16)

d = gemm(a, b)  # equals a @ b.T

Operators autotune after op.request_tune(). CUDA Graph support on H200 is validated, after warmup, for the calls in the graph test group. Every op whose manifest entry has a call-time tensor input and no composition supports torch.compile(fullgraph=True).

How the library grows

An implementation can be regenerated from its spec, but a spec cannot be recovered from an implementation. Agents work on the whole library, not only its kernels, so it needs to stay consistent as it grows.

  • Maintainable. Each op starts with a self-contained YAML spec, which is the sole input to code generation. Checks enforce the boundary between the Python op and the TileLang kernel.
  • Verifiable. The spec declares correctness and performance criteria before code is written. CI checks the spec, generated code, tests and benchmarks.
  • Tunable. The roofline model reports each kernel's gap to its bound, and nightly benchmarks compare each kernel with the fastest other implementation on the same GPU.
Inside an op spec

Each op has an entry in src/tileops/manifest/spec/, with one file per family. Abridged from gemm.yaml:

GEMMFwdOp:
  ref_api: nvmath.linalg.advanced.Matmul.execute
  family: gemm
  signature:
    forall: {M: Dim, N: Dim, K: Dim, T: "DType[float16 | bfloat16]"}
    params: {trans_a: {type: bool, default: false}, trans_b: {type: bool, default: true}}
    inputs: {a: {dtype: T, shape: "Mat[trans_a, M, K]"}, b: {dtype: T, shape: "Mat[trans_b, K, N]"}}
    outputs: {d: {dtype: T, shape: "[M, N]"}}
  workloads: [{M: 1024, N: 1024, K: 1024, trans_a: false, trans_b: false, dtype_cases: [{T: float16}, {T: bfloat16}], label: square-1k}]
  roofline: {flops: "2 * M * N * K"}

Mat[t, R, C] is a type the entry declares: the shape [R, C], or [C, R] when t is true.

Field Role
ref_api The API whose semantics the operator follows, when applicable.
signature Tensor types over named indices. Each call is checked against it before dispatch.
workloads The concrete calls used by contract tests and nightly benchmarks.
roofline The performance model. eval_roofline() evaluates it for each checked call.

A validator checks each entry against its implementation in CI. layer-boundaries.md states what each layer of an op owns.

Installation

pip install tileops

pip resolves PyTorch 2.13, TileLang 0.1.12 and PyYAML from PyPI. The machine provides the rest:

  • Linux and an NVIDIA GPU with compute capability 9.0 (SM90), with its driver
  • CUDA Toolkit 13.2, with nvcc on PATH: TileLang compiles kernels at run time

The release is verified on H200 with Python 3.12 and 3.13.

Some kernels also have SM80, SM86 or SM89 paths. They are tested on those devices when run there, and are outside the release verification.

To develop TileOPs, install it from source:

git clone https://github.com/tile-ai/TileOPs
cd TileOPs
pip install -e . --group dev -c constraints.txt   # constraints.txt pins what CI validates
pre-commit install

python -m pytest -q tests -m smoke           # verify; requires a CUDA GPU

A prebuilt Docker image includes the full stack and provides the CI environment. See development.md for details, test tiers, benchmarks and build troubleshooting.

Documentation

  • Docs site: API reference, user guides and nightly benchmarks.
  • Development guide: environment, tests and pull requests.
  • CONTRIBUTING.md: naming, PR structure and review criteria.
  • Design docs: architecture, manifest, roofline and layer boundaries.
  • API stability: public modules, compatibility promise, support scope and writing an op outside TileOPs.

License

TileOPs is released under the MIT License.

Metadata

Release files for tileops 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tileops 0.1.0
File Size Uploaded Provenance Actions
tileops-0.1.0.tar.gz 1.4 MB With provenance Details for tileops-0.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for tileops 0.1.0
File Interpreter ABI Platform Actions
tileops-0.1.0-py3-none-any.whl Python 3 none any Details for tileops-0.1.0-py3-none-any.whl

Total release size: 3.1 MB

Release files / tileops-0.1.0.tar.gz

Download URL tileops-0.1.0.tar.gz
Size 1.4 MB
Tags Source
SHA-256 checksum
How to use checksums
d4db61fdad6ca593b06d20ca9746c843086478fc3e88d30d57313967d1f09a12
BLAKE2b-256 checksum
How to use checksums
bd1e2ef977cb4c9364b1655e0edacc60e6c7708ac9cba719743198c521d7ecba
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

Release files / tileops-0.1.0-py3-none-any.whl

Download URL tileops-0.1.0-py3-none-any.whl
Size 1.8 MB
Tags Python 3
SHA-256 checksum
How to use checksums
ea14d6b8baa8fdbf8be7cbc324476c5b77daf8d3428ea9aadcb01ef76560eb51
BLAKE2b-256 checksum
How to use checksums
7f7f8ea1269afb7de1c4f0eb35b464da185d0be4710177ab10b7902e52dcb6c6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

Security for tileops 0.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Full provenance

Both files in this release have been uploaded with provenance metadata.

Select from 2 files

Attestation for tileops-0.1.0.tar.gz

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Oct 26, 2026.

Transparency log

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.0 This release

2 release files Full provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page