serving-utils 0.5.0

Some utilities for tensorflow serving

serving-utils

Some python utilities when using tensorflow-serving.

Installation

From PYPI: 1. Manually install tensorflow CPU or GPU version. 2. pip install serving-utils

From Github repository: 1. git clone [e-mail]:Yoctol/serving-utils.git 2. make install

Usage

1. Client ```python from serving_utils import Client

client = Client(addr=”localhost:8500”) client.predict(…)

or async

await client.async_predict(…) ```

2. Saver ```python import tensorflow as tf

from serving_utils import Saver

saver = Saver( session=tf.Session(graph=your_graph), output_dir=’/path/to/serving’, signature_def_map={ ‘predict’: tf.saved_model.signature_def_utils.predict_signature_def( inputs={‘tensor_name’: tf.Tensor…}, outputs={‘tensor_name’: tf.Tensor…}, ) }, ) saver.save(…)

## Test

Run the following commands:

make lint make test

## Dev

make install ```