A lightweight tool to monitor your OpenAI workload.
Project description
OpenAI Observability
A lightweight tool to monitor your OpenAI workload.
Installation
With pip
pip install nr-openai-observability
Getting Started
STEP 1: Set Your Environment Variables
- Get your License key (also referenced as
ingest - license
) and set it as environment variable:NEW_RELIC_LICENSE_KEY
. Click here for more details and instructions.
Bash
export NEW_RELIC_LICENSE_KEY=<license key>
Python
import os
os.environ["NEW_RELIC_LICENSE_KEY"] = "<license key>"
NEW_RELIC_LICENSE_KEY
can also be sent as a parameter at the monitor.initialization()
call.
- Are you reporting data to the New Relic EU region? click here for more instructions.
STEP 2: Add the following two lines to your code
from nr_openai_observability import monitor
monitor.initialization(
application_name="OpenAI observability example"
)
Code example:
import os
import openai
from nr_openai_observability import monitor
monitor.initialization(
application_name="OpenAI observability example"
)
openai.api_key = os.getenv("OPENAI_API_KEY")
response = openai.ChatCompletion.create(
model="gpt-3.5-turbo",
messages=[
{
"role": "user",
"content": "Write a rhythm about observability",
},
],
)
print(response["choices"][0]["message"]["content"])
STEP 3: Follow the instruction here to add the dashboard to your New Relic account.
EU Account Users:
If you are using an EU region account, you should also set your EVENT_CLIENT_HOST
:
Bash
export EVENT_CLIENT_HOST="insights-collector.eu01.nr-data.net"
Python
import os
os.environ["EVENT_CLIENT_HOST"] = "insights-collector.eu01.nr-data.net"
EVENT_CLIENT_HOST
can also be sent as a parameter at the monitor.initialization()
call.
Support
New Relic hosts and moderates an online forum where customers can interact with New Relic employees as well as other customers to get help and share best practices. Like all official New Relic open source projects, there's a related Community topic in the New Relic Explorers Hub. You can find this project's topic/threads here:
Contribute
We encourage your contributions to improve nr-openai-observability! Keep in mind that when you submit your pull request, you'll need to sign the CLA via the click-through using CLA-Assistant. You only have to sign the CLA one time per project.
If you have any questions, or to execute our corporate CLA (which is required if your contribution is on behalf of a company), drop us an email at opensource@newrelic.com.
A note about vulnerabilities
As noted in our security policy, New Relic is committed to the privacy and security of our customers and their data. We believe that providing coordinated disclosure by security researchers and engaging with the security community are important means to achieve our security goals.
If you believe you have found a security vulnerability in this project or any of New Relic's products or websites, we welcome and greatly appreciate you reporting it to New Relic through HackerOne.
If you would like to contribute to this project, review these guidelines.
To all contributors, we thank you! Without your contribution, this project would not be what it is today.
License
nr-openai-observability is licensed under the Apache 2.0 License. The nr-openai-observability also uses source code from third-party libraries. You can find full details on which libraries are used and the terms under which they are licensed in the third-party notices document.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file nr_openai_observability-0.3.1.tar.gz
.
File metadata
- Download URL: nr_openai_observability-0.3.1.tar.gz
- Upload date:
- Size: 14.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.12 Linux/5.15.0-1041-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b43da08f2e1ac9fa5541a49b6850168bcecfc035d3860ac718b0a30f288b89eb |
|
MD5 | 99a6e31e51b36c5d77107e74f572fcb4 |
|
BLAKE2b-256 | e3ca3cbdb21801c16e81b0d94081e3857d4dfcb2e9562b2c23aaf7b22cb3deb7 |
File details
Details for the file nr_openai_observability-0.3.1-py3-none-any.whl
.
File metadata
- Download URL: nr_openai_observability-0.3.1-py3-none-any.whl
- Upload date:
- Size: 15.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.4.0 CPython/3.10.12 Linux/5.15.0-1041-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f1fb7f29c531036da2714f94baf46f5286a74c4ace86426d43e4bd9838414c24 |
|
MD5 | 97f022967fce8b75c4149e911f6f20ea |
|
BLAKE2b-256 | e41a6bef2668f6fdd2b8a6305eea0f3537cc4700242c49a94df43140a02d8956 |