Skip to main content

Small TTNN readiness check for Tenstorrent systems

Project description

tt-check

tt-check is a small command-line readiness test for a Tenstorrent system with tt-smi and the public ttnn Python package installed.

It performs the following checks:

  1. Resets devices with tt-smi -r.
  2. Collects system information from tt-smi -s --snapshot_no_tty.
  3. Opens a TTNN device.
  4. Runs a simulated tensor-parallel three-weight gated MLP 100 times in both prefill and decode shapes:
    • BF16 activations
    • BFP8 weights
    • 1024 activation width per device shard
    • prefill rows: 1024
    • decode rows: 1
  5. Warms each MLP shape once, captures one dynamic TTNN trace per shape, then executes each trace for the requested run count.
  6. Compares each trace replay against a PyTorch reference with PCC >= 0.99 and requires TTNN output tensors to be identical across all replays.

Install

Preferred:

uv tool install --python 3.10 .

Or run directly from a checkout:

uv run tt-check

uv uses the PyTorch CPU wheel index for this project; the check only needs Torch for reference math. The project pins a Python version compatible with the current public ttnn wheels.

Pip also works:

python3 -m pip install .

Run

tt-check

The command exits 0 if all checks pass. It exits 1 and writes the failure to stderr otherwise.

Useful options:

tt-check --device-id 0 --runs 100 --pcc-threshold 0.99
tt-check --prefill-rows 1024 --decode-rows 1 --activation-width-per-device 1024

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tt_check-0.1.0.tar.gz (13.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tt_check-0.1.0-py3-none-any.whl (13.0 kB view details)

Uploaded Python 3

File details

Details for the file tt_check-0.1.0.tar.gz.

File metadata

  • Download URL: tt_check-0.1.0.tar.gz
  • Upload date:
  • Size: 13.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.18

File hashes

Hashes for tt_check-0.1.0.tar.gz
Algorithm Hash digest
SHA256 87c48a18b043a863f1b59f00d699c86e80ee3f32ad180b7f36843e6a8834641c
MD5 efed9339bcaa085845c2381c4e4c4bbe
BLAKE2b-256 418aa297ed1cd91ca210a6758c0b487bc7b2cdfa81e9977b383e9aa30a556f82

See more details on using hashes here.

File details

Details for the file tt_check-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: tt_check-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 13.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.18

File hashes

Hashes for tt_check-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 d9b41be51e4f56103a98c9e7db9aed3ae03f6efb8c0a00fa13aedc24bd46ccd7
MD5 bfeba3c6b686c0829feab9a74497757f
BLAKE2b-256 ea580f1a2f14b2995d0339e32ce91dfef2bc2ab43267b316c4a882259bbf41df

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page