Deploy your AI/ML model to Amazon SageMaker for Real-Time Inference and Batch Transform using your own Docker container image.
Project description
inference-server
Deploy your AI/ML model to Amazon SageMaker for Real-Time Inference and Batch Transform using your own Docker container image.
:blue_book: Documentation: https://inference-server.readthedocs.io
Installing
python -m pip install inference-server
Developing
To setup a scratch/development virtual environment (under .venv/
), first install Tox.
Then run:
tox -e dev
The inference-server
package is installed in editable mode inside the .venv/
environment.
Run tests by simply calling tox
.
Install code quality Git hooks using pre-commit install --install-hooks
.
Terms & Conditions
Copyright 2023 J.P. Morgan Chase & Co.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Contributing
See CONTRIBUTING.md
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file inference-server-1.2.1.tar.gz
.
File metadata
- Download URL: inference-server-1.2.1.tar.gz
- Upload date:
- Size: 29.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d8a2c9d44926b3dd1754495cc8aad6f43c023c201d74326d15d80baa2ae9c42 |
|
MD5 | 557255c12dd390a9383ff32329c46347 |
|
BLAKE2b-256 | afb36ecfcaf089117ab85cbbab3f7bbd3f8dfb626113fd38b607af7ea25bf8fa |
File details
Details for the file inference_server-1.2.1-py3-none-any.whl
.
File metadata
- Download URL: inference_server-1.2.1-py3-none-any.whl
- Upload date:
- Size: 19.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed8def850ad530d1441ffc2c4860776524ef48094fe43de8edb619a257175d53 |
|
MD5 | 4d6bc0b03729a51666dfdf4dae7710c7 |
|
BLAKE2b-256 | da9b674a05f7daf4f4fbbf5099673771583c7437443f56b7bff9d9334d3d7e2e |