MLflow runtime for MLServer
Project description
MLflow runtime for MLServer
This package provides a MLServer runtime compatible with MLflow models.
Usage
You can install the runtime, alongside mlserver
, as:
pip install mlserver mlserver-mlflow
Content Types
The MLflow inference runtime introduces a new dict
content type, which
decodes an incoming V2 request as a dictionary of
tensors.
This is useful for certain MLflow-serialised models, which will expect that the
model inputs are serialised in this format.
The `dict` content type can be _stacked_ with other content types, like
[`np`](../../docs/user-guide/content-type).
This allows the user to use a different set of content types to decode each of
the dict entries.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for mlserver-mlflow-1.2.0.dev1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 653051dfebf47cf55e2a6871625461d47f2ef2eb379b1f48ec71a71ad6b2730d |
|
MD5 | 4996280f323cb03fbfe027cc326073a9 |
|
BLAKE2b-256 | 33852e2a517cec360ef2a131ef03f8307774d1c2a2b143e60ae0831d9bea0b54 |
Close
Hashes for mlserver_mlflow-1.2.0.dev1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc2bceb6beb9eae5b12e5a1106b4ebdb5bb7c1dd9dc39fe2aa1b21900fa7cf3f |
|
MD5 | 1da6439ec94101dbf5fa336ac84fe533 |
|
BLAKE2b-256 | 5f33d19ae8736797a72650edc02cea967e6ced3344f3f9a28a90dcf6bd200c25 |