Skip to main content

A lightweight tool to monitor your OpenAI workload.

Project description

Community Project header

OpenAI Observability

A lightweight tool to monitor your OpenAI workload.

Installation

With pip

pip install nr-openai-observability

Getting Started

STEP 1: Set Your Environment Variables

  • Get your License key (also referenced as ingest - license) and set it as environment variable: NEW_RELIC_LICENSE_KEY. Click here for more details and instructions.

Bash

export NEW_RELIC_LICENSE_KEY=<license key>

Python

import os
os.environ["NEW_RELIC_LICENSE_KEY"] = "<license key>"

NEW_RELIC_LICENSE_KEY can also be sent as a parameter at the monitor.initialization() call.

  • Are you reporting data to the New Relic EU region? click here for more instructions.

STEP 2: Add the following two lines to your code

from nr_openai_observability import monitor
monitor.initialization(
    application_name="OpenAI observability example"
)

Code example:

import os

import openai
from nr_openai_observability import monitor

monitor.initialization(
    application_name="OpenAI observability example"
)

openai.api_key = os.getenv("OPENAI_API_KEY")
response = openai.ChatCompletion.create(
    model="gpt-3.5-turbo",
    messages=[
        {
            "role": "user",
            "content": "Write a rhythm about observability",
        },
    ],
)
print(response["choices"][0]["message"]["content"])

STEP 3: Follow the instruction here to add the dashboard to your New Relic account.

EU Account Users:

If you are using an EU region account, you should also set your EVENT_CLIENT_HOST:

Bash

export EVENT_CLIENT_HOST="insights-collector.eu01.nr-data.net"

Python

import os
os.environ["EVENT_CLIENT_HOST"] = "insights-collector.eu01.nr-data.net"

EVENT_CLIENT_HOST can also be sent as a parameter at the monitor.initialization() call.

Support

New Relic hosts and moderates an online forum where customers can interact with New Relic employees as well as other customers to get help and share best practices. Like all official New Relic open source projects, there's a related Community topic in the New Relic Explorers Hub. You can find this project's topic/threads here:

Contribute

We encourage your contributions to improve nr-openai-observability! Keep in mind that when you submit your pull request, you'll need to sign the CLA via the click-through using CLA-Assistant. You only have to sign the CLA one time per project.

If you have any questions, or to execute our corporate CLA (which is required if your contribution is on behalf of a company), drop us an email at opensource@newrelic.com.

A note about vulnerabilities

As noted in our security policy, New Relic is committed to the privacy and security of our customers and their data. We believe that providing coordinated disclosure by security researchers and engaging with the security community are important means to achieve our security goals.

If you believe you have found a security vulnerability in this project or any of New Relic's products or websites, we welcome and greatly appreciate you reporting it to New Relic through HackerOne.

If you would like to contribute to this project, review these guidelines.

To all contributors, we thank you! Without your contribution, this project would not be what it is today.

License

nr-openai-observability is licensed under the Apache 2.0 License. The nr-openai-observability also uses source code from third-party libraries. You can find full details on which libraries are used and the terms under which they are licensed in the third-party notices document.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nr_openai_observability-0.3.1.tar.gz (14.8 kB view details)

Uploaded Source

Built Distribution

nr_openai_observability-0.3.1-py3-none-any.whl (15.1 kB view details)

Uploaded Python 3

File details

Details for the file nr_openai_observability-0.3.1.tar.gz.

File metadata

  • Download URL: nr_openai_observability-0.3.1.tar.gz
  • Upload date:
  • Size: 14.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.4.0 CPython/3.10.12 Linux/5.15.0-1041-azure

File hashes

Hashes for nr_openai_observability-0.3.1.tar.gz
Algorithm Hash digest
SHA256 b43da08f2e1ac9fa5541a49b6850168bcecfc035d3860ac718b0a30f288b89eb
MD5 99a6e31e51b36c5d77107e74f572fcb4
BLAKE2b-256 e3ca3cbdb21801c16e81b0d94081e3857d4dfcb2e9562b2c23aaf7b22cb3deb7

See more details on using hashes here.

File details

Details for the file nr_openai_observability-0.3.1-py3-none-any.whl.

File metadata

File hashes

Hashes for nr_openai_observability-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f1fb7f29c531036da2714f94baf46f5286a74c4ace86426d43e4bd9838414c24
MD5 97f022967fce8b75c4149e911f6f20ea
BLAKE2b-256 e41a6bef2668f6fdd2b8a6305eea0f3537cc4700242c49a94df43140a02d8956

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page