Skip to main content

AI Observability and Evaluation

Project description

phoenix banner

Phoenix is an open-source AI observability platform designed for experimentation, evaluation, and troubleshooting. It provides:

  • Tracing - Trace your LLM application's runtime using using OpenTelemetry-based instrumentation.
  • Evaluation - Leverage LLMs to benchmark your application's performance using response and retrieval evals.
  • Inference Analysis - Visualize inferences and embeddings using dimensionality reduction and clustering to identify drift and performance degradation.

Phoenix is vendor and language agnostic with out-of-the-box support for popular frameworks (🦙LlamaIndex, 🦜⛓LangChain, 🧩DSPy) and LLM providers (OpenAI, Bedrock, and more). For details on auto-instrumentation, check out the OpenInference project.

Phoenix runs practically anywhere, including your Jupyter notebook, local machine, containerized deployment, or in the cloud.

Installation

Install Phoenix via pip or conda along with extra dependencies for running evals:

pip install 'arize-phoenix[evals]'

Phoenix container images are available via Docker Hub and can be deployed using Docker or Kubernetes.

Community

Join our community to connect with thousands of AI builders.

  • 🌍 Join our Slack community.
  • 💡 Ask questions and provide feedback in the #phoenix-support channel.
  • 🌟 Leave a star on our GitHub.
  • 🐞 Report bugs with GitHub Issues.
  • 𝕏 Follow us on 𝕏.
  • 💌️ Sign up for our mailing list.
  • 🗺️ Check out our roadmap to see where we're heading next.

Thanks

  • UMAP For unlocking the ability to visualize and reason about embeddings
  • HDBSCAN For providing a clustering algorithm to aid in the discovery of drift and performance degradation

Breaking Changes

See the migration guide for a list of breaking changes.

Copyright, Patent, and License

Copyright 2023 Arize AI, Inc. All Rights Reserved.

Portions of this code are patent protected by one or more U.S. Patents. See IP_NOTICE.

This software is licensed under the terms of the Elastic License 2.0 (ELv2). See LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astra_logs-4.2.8.tar.gz (1.9 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

astra_logs-4.2.8-py3-none-any.whl (2.0 MB view details)

Uploaded Python 3

File details

Details for the file astra_logs-4.2.8.tar.gz.

File metadata

  • Download URL: astra_logs-4.2.8.tar.gz
  • Upload date:
  • Size: 1.9 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.0

File hashes

Hashes for astra_logs-4.2.8.tar.gz
Algorithm Hash digest
SHA256 ad6432daa26d06bd2b5111195c048dff0e8060f0380a3105b20ecabeaa067fee
MD5 4a5823ad981e3645f2f4bf1783aba493
BLAKE2b-256 b8ea23cec0d8dc29d47b0f80ce973f5057105f75b566f394ff286f8022ad3fb6

See more details on using hashes here.

File details

Details for the file astra_logs-4.2.8-py3-none-any.whl.

File metadata

  • Download URL: astra_logs-4.2.8-py3-none-any.whl
  • Upload date:
  • Size: 2.0 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: python-httpx/0.27.0

File hashes

Hashes for astra_logs-4.2.8-py3-none-any.whl
Algorithm Hash digest
SHA256 0e2600af7b7b6b757d85b2fb5643c2c8350089c1b6a99f252e20ec70cdf49918
MD5 774949d511da4c3078d9753ca1b610c0
BLAKE2b-256 d40aa9c61099216450ee0cdffa26e3e36fbfad43c6767aae28456d856be0fa50

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page