model serving with asyncio, multiprocessing, and batching
Project description
mpservice
Model serving with asyncio, multiprocessing, and batching.
Although the code uses some machine-learning terminology to name things, the use case is generic.
Reference: Service Batching from Scratch, Again.
To install, do pip install mpservice
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mpservice-0.7.3.tar.gz
(9.0 kB
view hashes)
Built Distribution
Close
Hashes for mpservice-0.7.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 13e8861b1faf5a17f983d28e07d8d539b8c104d5ee7c184a9b06d0ab02344861 |
|
MD5 | 4f83bfc2b578a99a563e95d97c6ea12d |
|
BLAKE2b-256 | da1a8e900e68a2af146d0b11ecc203ffccdeef51535281fc682b6c14803e1631 |