TACHY-Compiler

TACHY-Compiler is a comprehensive deep learning compiler and platform conversion framework developed by Deeper-I. It is designed to bridge the gap between popular deep learning frameworks (like PyTorch) and the TACHY hardware accelerator runtime environment.

This compiler handles model parsing, optimization, tensor alignment, and binary generation. It robustly supports large-scale models, complex operators, and dual-checkpoint pipelines out of the box.

Key Features

• PyTorch to ONNX to TACHY: Seamless end-to-end compilation pipeline.
• Dual Checkpoint Compilation (compile-dual): Officially supports simultaneous parsing and compilation of Reference (eval / pre) and Target (comp / opt) checkpoints into a unified output structure.
• Large Model Support: Built-in mechanisms to handle models larger than the Protobuf 2GB limit using external_data mapping.
• Robust ONNX Versioning: Automatically utilizes ONNX Opset 18 for stability, equipped with automatic version conversion and fallback mechanisms to mitigate onnxscript conversion issues.
• MCP Server Integrated: Exposes tools to LLMs and agentic frameworks via the Model Context Protocol (MCP) using FastMCP.
• Dynamic Binary Resolution: Intelligently locates dependency binaries utilizing environment variables (TACHY_UTIL_PATH) and relative package paths.

Installation

You can install TACHY-Compiler directly via PyPI:

pip install TACHY-Compiler

Requirements

• Python >= 3.8
• numpy, networkx, onnx, commentjson, ordered-set, easydict, DDesignerAPI
• (Optional) torch if utilizing the PyTorch to ONNX conversion pipeline.

CLI Usage

TACHY-Compiler provides a simple, unified command-line interface under the tachy command.

1. Dual Checkpoint Compilation

Best for executing the full compilation pipeline for two checkpoints (e.g. eval and comp) simultaneously. Intermediate files are automatically managed and cleaned up if requested.

tachy compile-dual \
    --eval_model ./eval_model.pth \
    --comp_model ./comp_model.pth \
    --input_shape "[1,3,224,224]" \
    --output_dir ./dual_output \
    --cleanup

Outputs will be cleanly structured into ./dual_output/final_binaries/eval/ and ./dual_output/final_binaries/comp/.

2. Single Model Pipeline Steps

If you need granular control, you can execute the pipeline steps individually.

Convert PyTorch to ONNX

tachy convert-pt2onnx ./model.pth ./model.onnx "[1,3,224,224]" False

Lint ONNX Model (--format table|markdown|json, --strict treats WARN as failure, --buffer_size N for width check)

tachy lint ./model.onnx
tachy lint ./model.onnx --suggest                   # search remedies for failed checks
tachy lint ./model.onnx --fix ./model_fixed.onnx    # repeat lint -> remedy until clean (--iterate N, default 5)

Each check lives in src/tachy_compiler/compiler/lint/rules/<id>_*.py together with its remedies (exact: same I/O, layout: host must permute the input, advisory: retraining needed). Remedies are verified by a full re-lint and an onnxruntime equivalence check. compile-dual --auto_fix applies the best remedy before ONNX → TACHY conversion.

Convert ONNX to TACHY Format

tachy convert-onnx ./model.onnx ./model.json

Compile TACHY JSON to Runtime Binaries

tachy compile ./model.json ./output_bin_dir

3. Model Context Protocol (MCP) Server

You can spin up the built-in MCP server to allow LLMs and AI Agents to compile models on your behalf.

tachy mcp

Environment Variables

• TACHY_UTIL_PATH (Optional): An absolute path to the directory containing external utility binaries (fc.out, block_4bit.out). If not set, the compiler will intelligently look for the optional directory within the installed package.

License

This project is licensed under the BSD-3-Clause License. See the LICENSE file for details.