Alibi-Detect runtime for MLServer
Project description
Alibi-Detect runtime for MLServer
This package provides a MLServer runtime compatible with alibi-detect models.
Usage
You can install the mlserver-alibi-detect
runtime, alongside mlserver
, as:
pip install mlserver mlserver-alibi-detect
For further information on how to use MLServer with Alibi-Detect, you can check out this worked out example.
Content Types
If no content type is present on the request or metadata, the Alibi-Detect runtime will try to decode the payload as a NumPy Array. To avoid this, either send a different content type explicitly, or define the correct one as part of your model's metadata.
Settings
The Alibi Detect runtime exposes a couple setting flags which can be used to
customise how the runtime behaves.
These settings can be added under the parameters.extra
section of your
model-settings.json
file, e.g.
---
emphasize-lines: 6-8
---
{
"name": "drift-detector",
"implementation": "mlserver_alibi_detect.AlibiDetectRuntime",
"parameters": {
"uri": "./alibi-detect-artifact/",
"extra": {
"batch_size": 5
}
}
}
Reference
You can find the full reference of the accepted extra settings for the Alibi Detect runtime below:
.. autopydantic_settings:: mlserver_alibi_detect.runtime.AlibiDetectSettings
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for mlserver-alibi-detect-1.4.0.dev2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad047e7fac1a30b822c16ebaa7de254476be084a1f2f8091d3c0e742e65cc4da |
|
MD5 | 5e95ced88a2161f87a20e7ec462944ce |
|
BLAKE2b-256 | 1e9bd8de9dd6f90d71c11ff42051fb1c8ea4f84b45d6f1568c2847cbef247ac6 |
Hashes for mlserver_alibi_detect-1.4.0.dev2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3f41f9cce3b5950b9a6538653be7bcb108bfd74609b3d69331fe0daf18623c10 |
|
MD5 | 62bfe4476b1fca14f638268193fd3681 |
|
BLAKE2b-256 | 0dd5f897c642e6ead49d4de590032351e6001cf5859b2e8c6e689a7e67bbb6fb |