Some utilities for tensorflow serving
Project description
serving-utils
Some python utilities when using tensorflow-serving.
Installation
From PYPI: 1. Manually install tensorflow CPU or GPU version. 2. pip install serving-utils
From Github repository: 1. git clone git@github.com:Yoctol/serving-utils.git 2. make install
Usage
Saver ```python import tensorflow as tf
from serving_utils import Saver
saver = Saver( session=tf.Session(graph=your_graph), output_dir=’/path/to/serving’, signature_def_map={ ‘predict’: tf.saved_model.signature_def_utils.predict_signature_def( inputs={‘input’: tf.Tensor…}, outputs={‘output’: tf.Tensor…}, ) }, ) saver.save(…) ```
Saver ```python from serving_utils import Client, PredictInput
client = Client(addr=”localhost:8500”) client.predict( [PredictInput(name=’input’, value=np.ones(1, 10))], output_names=[‘output’], model_signature_name=’predict’, )
or async
await client.async_predict(…)
## Test Run the following commands:
make lint make test
## Dev
make install ```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for serving_utils-0.5.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a834bd8115d831f132b5875dbcc93602b279c61fe73032a7c8d2d446cefe8222 |
|
MD5 | 33e530a02a55d9c09a4e3fd4ae5cec37 |
|
BLAKE2b-256 | bd3eb988bf3d5382bd8b7490294fee63d264d7fdd9105401e90ccbd3b068ca4f |