This release is a pre-release and may not be stable for production use.
TitanML iris package
🎯 About
Iris is your portal to the TitanML platform. Using Iris, you can setup Takeoff servers, launch jobs to run on TitanML servers, run your own models and datasets through our compression algorithms, and explore and download the optimised models from the Titan Store.
For usage information, tutorials, and usage examples, see the docs.
New! Try the TitanML Takeoff Server
✔️ Easy deployment and streaming responses for popular Large Language Models
✔️ Optimized int8 quantization
✔️ Chat and playground-like interface
✔️ Support for encoder-decoder (T5 family) and decoder models
For the pro edition, including multi-gpu inference, int4 quantization, and more contact us
Dependencies
Iris is tested on the following versions of python:
- python >= 3.7 <=3.10
Iris should work on later versions, but likely won't work on earlier versions.
iris API
Usage:
$ iris [OPTIONS] COMMAND [ARGS]...
Options:
--help: Show this message and exit.
Commands:
delete: delete objects from the TYTN api.download: Download the titan-optimized onnx model.get: Get objects from the TYTN api.infer: Run inference on a model.login: Login to iris.logout: Logout from iris.makesafe: Convert a non-safetensor model into a...post: Dispatch a job to the TitanML platformpull: Pull the titan-optimized server docker image.status: Get the status of an experimentupload: Upload an artefact to the TitanML hub.takeoff: Launch a TitanML inference server. See docs for more information.
Help
For more information on the Iris CLI, see the docs.
Authors
TitanML
Metadata
Release files for titan-iris 0.47.5.dev149
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| titan-iris-0.47.5.dev149.tar.gz | 49.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| titan_iris-0.47.5.dev149-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 94.9 kB
Release files / titan-iris-0.47.5.dev149.tar.gz
| Download URL | titan-iris-0.47.5.dev149.tar.gz |
|---|---|
| Size | 49.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
458e81472bb174c1dc35a0003f372f164740589c4df3c3b0f44ed9b58424667a
|
|
BLAKE2b-256 checksum How to use checksums |
53dc0ac05449c8330a2a0b044ae6ad07115bd329879b01200d7cc8f01fb524df
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.18
|
Release files / titan_iris-0.47.5.dev149-py3-none-any.whl
| Download URL | titan_iris-0.47.5.dev149-py3-none-any.whl |
|---|---|
| Size | 45.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8adebde023b3e219e94e65501a6e00dc3dbe61fcf80b4510f61711c4364cc361
|
|
BLAKE2b-256 checksum How to use checksums |
521d49debfe9dbbf5cab2a35271d2abedc1acc9473263e3036efd8bc26d0bad9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.18
|