A helper library to interact with Arize AI APIs
Project description
Arize AI
Overview
A helper library to interact with Arize AI APIs
Quickstart
Instrument your model to log predictions and latent truth events. The logged events allow the Arize platform to generate visualizations of features, model output and prediction evaluation metrics. Additionally the platform will provide data quality monitoring and data distribution alerts, for your production models.
Start logging with the following steps.
1. Create your account
Sign up for a free account by reaching out to contacts@arize.com.
2. Get your service key
When you create an account, we generate a service api key. You will need this API Key and account id for logging authentication.
3. Instrument your code
Python Client
If you are using our python client, add a few lines to your code to log predictions and truths. Logs are sent to Arize asynchrously.
Install Library
Install our library in an environment using Python 3.
$ pip3 install arize
Or clone the repo:
$ git clone https://github.com/Arize-ai/client_python.git
$ python setup.py install
Initialize Python Client
Initialize arize
at the start of your sevice using your previously created Account ID and API Key
NOTE: We suggest adding the API KEY as secrets or an environment variable.
from arize.api import AsyncClient
API_KEY = os.environ.get('ARIZE_API_KEY')
arize = AsyncClient(account_id=1234, api_key=API_KEY, uri='https://dev.arize.com/v1/log')
Collect your model input features and labels you'd like to track
You can track all input features used to at prediction time by logging it via a string:string dictionary.
labels = {
'state': 'ca',
'city': 'berkeley',
'lat': '37.8717',
'lng': '-122.2579',
'merchant_type': 'educational',
'charge_amount': '20.11',
}
Log Predictions
arize.log(
model_id='sample-model-1',
model_version='v1.23.64', //Optional
prediction_id='plED4eERDCasd9797ca34',
prediction_value=True,
labels=labels,
)
We automatically discover new models logged over time based on the model ID sent on each prediction.
Log Truths
arize.log(
model_id='sample-model-1',
prediction_id='plED4eERDCasd9797ca34',
truth_value=True,
)
Once a truth for a prediction is determined, you can log those to Arize and evaluate your metrics over time. What links the truch to the original prediction is the prediction_id for a model_id
4. Log In for Analytics
That's it! Once your service is deployed and predictions are logged you'll be able to log into your Arize account and dive into your data. Slicing it by feature labels, models, time, etc.
Analytics Dashboard
Other languages
If you are using a different language, you'll be able to post an HTTP request to our Arize edge-servers to log your events.
HTTP post request to Arize
curl -X POST -H "Authorization: API_KEY" "https://dev.arize.com/v1/log" -d'{"account_id": 0, "model_id": "test_model_1", "prediction_id":"test100", "prediction":{"model_version": "v1.23.64", "labels":{"state":"CO", "type":"restaurant"}, "prediction_value": {"binary_value": false}}}'
Contributing
TBD
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for arize-0.0.5-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a1fa50c868c089ebe6198eaf3ec727341fad5f43117f39d975a2211233be9cd |
|
MD5 | a2a0aa12c0a2d93d2de8daba4f78768b |
|
BLAKE2b-256 | ad4eaad68c61aa9e39378af4b859dfb3a5c30e151e73f40c78e086287577a52e |