Skip to main content

Tensorflow gRPC and RESTful API Server

Introduce

tfserver is an example for serving gRPC for Tensorflow/Pytorch thing’s models.

It can serve not only through gRPC but also RESTful API with Skitai App Engine and Atila WSGI container.

This project is inspired by issue #176.

I’m so sorry about this soulless manual.

Installation

  • from version 0.3, it is now TensorFlow 2+ compatible (deprecated, no longer support)

  • from version 0.4, TensorFlow 2+ only

Building Model and Deploy

Please see https://gitlab.com/hansroh/skitai/-/blob/master/tests/level4-2/build_model.py

It is mostly used tensorflow keras and dnn.

Creating Your Own gRPC Server

Please see https://gitlab.com/hansroh/skitai/-/blob/master/tests/examples/tfserve.py

You can know how to serve gRPC service and make yoyr own APIs.

APIs

Please see https://gitlab.com/hansroh/tfserver/-/blob/master/tfserver/export/skitai/__export__.py

APIs to manage models and basic inference.

And for usage see, https://gitlab.com/hansroh/skitai/-/blob/master/tests/level4-2/test_tfserver.py

Release History

  • 0.4 (2021. 4)

    • upgrade for tensorflow 2

  • 0.3 (2020. 6. 28)

    • add model management APIs

    • reactivate project and compatible with TF2+

  • 0.2 (2020. 6. 26): integrated with dnn 0.3

  • 0.1b8 (2018. 4. 13): fix grpc trailers, skitai upgrade is required

  • 0.1b6 (2018. 3. 19): found works only grpcio 1.4.0

  • 0.1b3 (2018. 2. 4): add @app.umounted decorator for clearing resource

  • 0.1b2: remove self.tfsess.run (tf.global_variables_initializer())

  • 0.1b1 (2018. 1. 28): Beta release

  • 0.1a (2018. 1. 4): Alpha release

Metadata

Release files for tfserver 0.4.11

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for tfserver 0.4.11
File Interpreter ABI Platform
tfserver-0.4.11-py3-none-any.whl Python 3 none any Details

Release files / tfserver-0.4.11-py3-none-any.whl

Download URL tfserver-0.4.11-py3-none-any.whl
Size 27.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f16d795e135049555c10c3f3daa505d204906591d9d186fcae9f0666db7d6411
BLAKE2b-256 checksum
How to use checksums
42639e65d4f97191f7544baa037766c40ebf94e15c7233ccaed636fa600c218f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.1 CPython/3.7.12

Release history Release notifications | RSS feed

This release

0.4.11 This release

1 release file

0.4.10

1 release file

0.4.9

1 release file

0.4.8

1 release file

0.4.7

1 release file

0.4.6

1 release file

0.4.5.6

1 release file

0.4.5.5

1 release file

0.4.5

1 release file

0.4.4

1 release file

0.4.3

1 release file

0.4.2

1 release file

0.4.1

1 release file

0.4.0

1 release file

0.3.10

1 release file

0.3.9

1 release file

0.3.8.3

1 release file

0.3.8.2

1 release file

0.3.8

1 release file

0.3.7

1 release file

0.3.6

1 release file

0.3.5.6

1 release file

0.3.5.5

1 release file

0.3.5.4

1 release file

0.3.5.3

1 release file

0.3.5.2

1 release file

0.3.5.1

1 release file

0.3.5

1 release file

0.3.3

1 release file

0.3.2

1 release file

0.3.1.1

1 release file

0.3.1

1 release file

0.3.0

1 release file

0.2.0.9

1 release file

0.2.0.8

1 release file

0.2.0.7

1 release file

0.2.0.6

1 release file

0.2.0.4

1 release file

0.2.0.3

1 release file

0.2

1 release file

0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page