Arrow Flight simple API service
Project description
Aflight: simple Arrow Flight API builder/runner
Loosely inspired by Flask
TL;DR
Server:
Create app.py
import aflight
app = aflight.Aflight()
@app.command("predict")
def predict(batch):
result = do_something_with(batch)
return [result]
To Run:
aflight
Client:
from aflight.client import predict
data = some_pandas_data()
print(predict(data))
Why?
Current kserve
, torch/serve
etc. APIs are too reliant on HTTP request/response paradigm
Using Arrow as a data format and Arrow Flight as a service API produces a much better interface:
- standard
- has schema
- fast
- columnar
- batch-able
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.