Some utilities for tensorflow serving
Project description
# serving-utils
[![Build Status](https://travis-ci.org/Yoctol/serving-utils.svg?branch=master)](https://travis-ci.org/Yoctol/serving-utils) [![PyPI version](https://badge.fury.io/py/serving-utils.svg)](https://badge.fury.io/py/serving-utils)
Some python utilities when using tensorflow-serving.
## Installation
From PYPI:
1. Manually install tensorflow CPU or GPU version.
2. `pip install serving-client`
From Github repository:
1. `git clone git@github.com:Yoctol/serving-utils.git`
2. `make install`
## Usage
1. Client
```python
from serving_utils import Client
client = Client(addr="localhost:8500")
client.predict(...)
# or async
await client.async_predict(...)
```
2. Saver
```python
import tensorflow as tf
from serving_utils import Saver
saver = Saver(
session=tf.Session(graph=your_graph),
output_dir='/path/to/serving',
signature_def_map={
'predict': tf.saved_model.signature_def_utils.predict_signature_def(
inputs={'tensor_name': tf.Tensor...},
outputs={'tensor_name': tf.Tensor...},
)
},
)
saver.save(...)
```
## Test
Run the following commands:
```
make lint
make test
```
[![Build Status](https://travis-ci.org/Yoctol/serving-utils.svg?branch=master)](https://travis-ci.org/Yoctol/serving-utils) [![PyPI version](https://badge.fury.io/py/serving-utils.svg)](https://badge.fury.io/py/serving-utils)
Some python utilities when using tensorflow-serving.
## Installation
From PYPI:
1. Manually install tensorflow CPU or GPU version.
2. `pip install serving-client`
From Github repository:
1. `git clone git@github.com:Yoctol/serving-utils.git`
2. `make install`
## Usage
1. Client
```python
from serving_utils import Client
client = Client(addr="localhost:8500")
client.predict(...)
# or async
await client.async_predict(...)
```
2. Saver
```python
import tensorflow as tf
from serving_utils import Saver
saver = Saver(
session=tf.Session(graph=your_graph),
output_dir='/path/to/serving',
signature_def_map={
'predict': tf.saved_model.signature_def_utils.predict_signature_def(
inputs={'tensor_name': tf.Tensor...},
outputs={'tensor_name': tf.Tensor...},
)
},
)
saver.save(...)
```
## Test
Run the following commands:
```
make lint
make test
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
serving-utils-0.3.0.tar.gz
(3.5 kB
view hashes)
Built Distribution
Close
Hashes for serving_utils-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4b50766b5361a8f8bc67dbe8545b00278ffa9957976b869b1f74c5edf995da78 |
|
MD5 | 395323d87f3f5536263b36b1d657ba79 |
|
BLAKE2b-256 | 01a80e84bffdd6b7c6aca8106d707c9b5fcada407d87b91b6e6ab7bd636ad6c7 |