This release is a pre-release and may not be stable for production use.
Apache MXNet Model Server (MMS) is a flexible and easy to use tool for serving deep learning models exported from MXNet or the Open Neural Network Exchange (ONNX).
Use the MMS Server CLI, or the pre-configured Docker images, to start a service that sets up HTTP endpoints to handle model inference requests.
Detailed documentation and examples are provided in the docs folder.
Prerequisites
java 8: Required. MMS use java to serve HTTP requests. You must install java 8 (or later) and make sure java is on available in $PATH environment variable before installing MMS. If you have multiple java installed, you can use $JAVA_HOME environment vairable to control which java to use.
mxnet: mxnet will not be installed by default with MMS 1.0 any more. You have to install it manually if you use MxNet.
For ubuntu:
sudo apt-get install openjdk-8-jre-headless
For centos
sudo yum install java-1.8.0-openjdk
For Mac:
brew tap caskroom/versions brew update brew cask install java8
Install MxNet:
pip install mxnet
MXNet offers MKL pip packages that will be much faster when running on Intel hardware. To install mkl package for CPU:
pip install mxnet-mkl
or for GPU instance:
pip install mxnet-cu92mkl
Installation
pip install mxnet-model-server
Development
We welcome new contributors of all experience levels. For information on how to install MMS for development, refer to the MMS docs.
Important links
Source code
You can check the latest source code as follows:
git clone https://github.com/awslabs/mxnet-model-server.git
Testing
After installation, try out the MMS Quickstart for
Help and Support
Citation
If you use MMS in a publication or project, please cite MMS: https://github.com/awslabs/mxnet-model-server
1 maintainer
Release files for mxnet-model-server 1.0.3b20190324
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| mxnet_model_server-1.0.3b20190324-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Release files / mxnet_model_server-1.0.3b20190324-py2.py3-none-any.whl
| Download URL | mxnet_model_server-1.0.3b20190324-py2.py3-none-any.whl |
|---|---|
| Size | 4.5 MB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
7785459a7fb0e4af84181cf617b3d12c444973807f07f4ec458b64e08e83ed72
|
|
BLAKE2b-256 checksum How to use checksums |
8913843b784d1bb32f222c39ac0c467c204e5b89b49c521643d16803917a3279
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/39.2.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/2.7.12
|
