Python client to use the Hectiq Console
Project description
Hectiq console collector
A python package to track your inference API using the Hectiq Console.
This service is for Hectiq's client only.
Middleware for API
Installation
pip install hectiq-console[starlette]
Starlette
Below is an example how to use the middleware for Starlette application.
from starlette.applications import Starlette
from starlette.middleware import Middleware
from hectiq_console.starlette import HectiqConsoleStarletteMiddleware
middleware = [
Middleware(HectiqConsoleStarletteMiddleware,
ressource="hectiq-test")
]
app = Starlette(middleware=middleware)
FastAPI
Below is an example how to use the middleware for FastAPI. It shares the same Middleware as Starlette.
import time
import random
from fastapi import FastAPI, Request
from hectiq_console.starlette import HectiqConsoleStarletteMiddleware, store_metrics
app = FastAPI(title="Demo application")
app.add_middleware(HectiqConsoleStarletteMiddleware,
ressource="hectiq-demo",
include_paths=["/predict"])
@app.get("/")
async def root():
return {"message": "🚨 This route is not monitored by the hectiq console."}
@app.get("/predict")
async def root(request: Request):
# Store a random number
return {"message": "✅ This route is monitored by the hectiq console."}
Send metrics
By default, the middleware stores the latency and counts of the monitored requests. You may add other metrics using the store_metrics
in a request handler.
@app.get("/predict")
async def root(request: Request):
store_metrics(request=request, key=metrics_key, value=metrics_value)
You can send as many metrics in the same request as you want. However, if you use the same key in the same request, the previous value is overwritten by the new one.
Do not forget to create the metrics definition in the console beforehand. Otherwise, you'll get an error at handshake.
Send annotations
Annotations are useful to track predictions in your application. For example, you may want to track the result of a model. Use the method store_annotation
. You can send as many annotations as you want in the same request.
@app.get("/predict")
async def root(request: Request):
store_annotation(request=request,
inputs={"y": [0,1,2,3,4], "x": [0,1,2,3,4]},
outputs={"y_true": [5,6,7,8], "y_pred": [5,6,7,8]},
label="high-accuracy",
metadata={"model": "demo-model",
"accuracy": 0.89})
Functional for workers
Installation
pip install hectiq-console
In addition to the middleware, you can use the functional to send metrics, annotations, and files. These methods are useful for workers that do not have access to the request object.
The ressource must be set before using the functional. You can set the ressource using the set_ressource
method. Place this method at the beginning of your script. It uses a ContextVar to store the ressource. Therefore, you can use it in a multi-threaded environment.
import hectiq_console.functional as hc
def execute():
hc.set_ressource("demo-ressource")
# Send a file with the ressource
hc.add_file(filename="test.png")
hc.add_metrics(name="active-cpus", value=5)
# # Create an incident
hc.create_incident(title="Incident with files",
description="CPU usage is too high. Please check the logs.",
filenames=["test.png", "main.py"])
# Sleep for 1 second and push the metrics
with hc.timer_context(name="sub-timer"):
# Do something.
pass
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for hectiq_console-1.1.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f71a27b0d58bedfa317851bd37104194703eb72482570ba60e93aec63c73857 |
|
MD5 | 57acb2011ed85a79a22a3f9808960fe8 |
|
BLAKE2b-256 | 772c0ef327e05a50d36ee75509f640ac53bb591c6f53b270bc6e949f4ea3ef19 |