Python SDK to configure and run evaluations for your LLM-based application

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Project description

Overview

Athina is an Observability and Experimentation platform for AI teams.

This SDK is an open-source repository of 50+ preset evals. You can also use custom evals.

This SDK also serves as a companion to Athina IDE where you can prototype pipelines, run experiments and evaluations, and compare datasets.

Quick Start

Follow this notebook for a quick start guide.

To get an Athina API key, sign up at https://app.athina.ai

Run Evals

These evals can be run programmatically, or via the UI on Athina IDE.

image

Compare datasets side-by-side (Docs)

Once a dataset is logged to Athina IDE, you can also compare it against another dataset.

image

Once you run evals using Athina, they will be visible in Athina IDE where you can run experiments, evals, and compare datasets side-by-side.

Preset Evals

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Release history Release notifications | RSS feed

1.6.12

This version

1.6.11

1.6.10

1.6.9

1.6.8

1.6.7

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.30

1.5.29

1.5.28

1.5.27

1.5.26

1.5.25

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.28

1.4.27

1.4.26

1.4.25

1.4.24

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.3

1.3.2

1.3.1

1.3.0

1.2.19

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.0

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

athina-1.6.11.tar.gz (128.0 kB view details)

Uploaded Source

Built Distribution

athina-1.6.11-py3-none-any.whl (195.1 kB view details)

Uploaded Python 3

File details

Details for the file athina-1.6.11.tar.gz.

File metadata

  • Download URL: athina-1.6.11.tar.gz
  • Upload date:
  • Size: 128.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.9.13 Darwin/23.5.0

File hashes

Hashes for athina-1.6.11.tar.gz
Algorithm Hash digest
SHA256 5230b34b18b053e8b189d265e3cc647c4e5cb10e480b2d702fb24e12c1813aff
MD5 ada4568bdf6d8fe8ffea0372c3a7e5e3
BLAKE2b-256 a54320f804bdf7ad35ff6d90beeecf75144c2b67015ac9419f55e84eb4196508

See more details on using hashes here.

File details

Details for the file athina-1.6.11-py3-none-any.whl.

File metadata

  • Download URL: athina-1.6.11-py3-none-any.whl
  • Upload date:
  • Size: 195.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.9.13 Darwin/23.5.0

File hashes

Hashes for athina-1.6.11-py3-none-any.whl
Algorithm Hash digest
SHA256 e2ea6fef741cc16bf6ca5a13846e8c7fcb6c5b66806f15be4d8f5c760b8b6eb1
MD5 296698c4d6058d13a58c35ff5b558220
BLAKE2b-256 859c95b6a298d7b262cf4f4203a65dc736ea4570e31da121a515df16aa5fd27d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page