Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Apache MXNet Model Server (MMS) is a flexible and easy to use tool for serving deep learning models exported from MXNet or the Open Neural Network Exchange (ONNX).

Use the MMS Server CLI, or the pre-configured Docker images, to start a service that sets up HTTP endpoints to handle model inference requests.

Detailed documentation and examples are provided in the docs folder.

Prerequisites

  • java 8: Required. MMS use java to serve HTTP requests. You must install java 8 (or later) and make sure java is on available in $PATH environment variable before installing MMS. If you have multiple java installed, you can use $JAVA_HOME environment vairable to control which java to use.

  • mxnet: mxnet will not be installed by default with MMS 1.0 any more. You have to install it manually if you use MxNet.

For ubuntu:

sudo apt-get install openjdk-8-jre-headless

For centos

sudo yum install java-1.8.0-openjdk

For Mac:

brew tap caskroom/versions
brew update
brew cask install java8

Install MxNet:

pip install mxnet

MXNet offers MKL pip packages that will be much faster when running on Intel hardware. To install mkl package for CPU:

pip install mxnet-mkl

or for GPU instance:

pip install mxnet-cu92mkl

Installation

pip install mxnet-model-server

Development

We welcome new contributors of all experience levels. For information on how to install MMS for development, refer to the MMS docs.

Source code

You can check the latest source code as follows:

git clone https://github.com/awslabs/mxnet-model-server.git

Testing

After installation, try out the MMS Quickstart for

Help and Support

Citation

If you use MMS in a publication or project, please cite MMS: https://github.com/awslabs/mxnet-model-server

Metadata

Release files for mxnet-model-server-prometheus 1.0.3b20190320

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mxnet-model-server-prometheus 1.0.3b20190320
File Size Uploaded
mxnet-model-server-prometheus-1.0.3b20190320.macosx-10.14-x86_64.tar.gz 4.6 MB Details

Built distributions (wheels)

Table of built distributions (wheels) for mxnet-model-server-prometheus 1.0.3b20190320
File Interpreter ABI Platform
mxnet_model_server_prometheus-1.0.3b20190320-py3-none-any.whl Python 3 none any Details
mxnet_model_server_prometheus-1.0.3b20190320-py2.py3-none-any.whl Python 3, Python 2 none any Details

Total release size: 13.7 MB

Release files / mxnet-model-server-prometheus-1.0.3b20190320.macosx-10.14-x86_64.tar.gz

Download URL mxnet-model-server-prometheus-1.0.3b20190320.macosx-10.14-x86_64.tar.gz
Size 4.6 MB
Tags Source
SHA-256 checksum
How to use checksums
e420307a388ec08470d8838178ad492d0d076739aa943bb31dadb2e30bd05dea
BLAKE2b-256 checksum
How to use checksums
c6bd0b4fd48d224fcc5034b1209c06856beb97ce292e02bc3adb37cce436d506
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.20.1 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

Release files / mxnet_model_server_prometheus-1.0.3b20190320-py3-none-any.whl

Download URL mxnet_model_server_prometheus-1.0.3b20190320-py3-none-any.whl
Size 4.6 MB
Tags Python 3
SHA-256 checksum
How to use checksums
5650d066700c8d97ee14de508222f10d8da5d286b345b3df0970bffe3bd90e14
BLAKE2b-256 checksum
How to use checksums
70b441fd81f7b37531dc991059319e0b88293cbeff8e853ed53583e47166036c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.20.1 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

Release files / mxnet_model_server_prometheus-1.0.3b20190320-py2.py3-none-any.whl

Download URL mxnet_model_server_prometheus-1.0.3b20190320-py2.py3-none-any.whl
Size 4.6 MB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
b1193e3b1143c883b6916c471451511421e8c6204c66ef97aaff8b0fb5bb3fc8
BLAKE2b-256 checksum
How to use checksums
645bd63acb3e2ac458599ca5e5ad4f0c642e0909d391f5e3dd1b8e2dd2b52394
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.13.0 pkginfo/1.5.0.1 requests/2.20.1 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page