triton-python-backend-mock-utils 1.0.0

Mock library for triton python backend utils.

triton_python_backend_mock_utils

This is a mock library for the triton_python_backend_utils python package that is available inside a triton server python backend runtime. This mock library is intended to be used for local development and unit testing of triton python backend models outside the triton server container environment. This library attempts to replicate the interface of the triton_python_backend_utils package, but may not have full functionality or behavior of the original package. PRs are welcome to improve the mock library to better match the real package. Please see the contributing guide for contribution instructions and guidelines.

The need for this mock library was brought up in the following GitHub issue: https://github.com/triton-inference-server/server/issues/5813

Installation

You can install the mock library via pip:

pip install triton_python_backend_mock_utils

Usage

You can now import and use the triton_python_backend_utils module in your local python environment for type hints and unit testing. Please see the python backend documentation for more details on available functionality and usage.

You can reference our example model to see the usage which includes a __main__ block for local testing. You can run this model in your local python environment by running:

python examples/model.py