Python SDK to configure and run evaluations for your LLM-based application

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Project description

Overview

Athina is an Observability and Experimentation platform for AI teams.

This SDK is an open-source repository of 50+ preset evals. You can also use custom evals.

This SDK also serves as a companion to Athina IDE where you can prototype pipelines, run experiments and evaluations, and compare datasets.

Quick Start

Follow this notebook for a quick start guide.

To get an Athina API key, sign up at https://app.athina.ai

Run Evals

These evals can be run programmatically, or via the UI on Athina IDE.

image

Compare datasets side-by-side (Docs)

Once a dataset is logged to Athina IDE, you can also compare it against another dataset.

image

Once you run evals using Athina, they will be visible in Athina IDE where you can run experiments, evals, and compare datasets side-by-side.

Preset Evals

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Release history Release notifications | RSS feed

This version

1.6.12

1.6.11

1.6.10

1.6.9

1.6.8

1.6.7

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.30

1.5.29

1.5.28

1.5.27

1.5.26

1.5.25

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.28

1.4.27

1.4.26

1.4.25

1.4.24

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.3

1.3.2

1.3.1

1.3.0

1.2.19

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.0

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

athina-1.6.12.tar.gz (127.7 kB view details)

Uploaded Source

Built Distribution

athina-1.6.12-py3-none-any.whl (195.3 kB view details)

Uploaded Python 3

File details

Details for the file athina-1.6.12.tar.gz.

File metadata

  • Download URL: athina-1.6.12.tar.gz
  • Upload date:
  • Size: 127.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.9.13 Darwin/23.5.0

File hashes

Hashes for athina-1.6.12.tar.gz
Algorithm Hash digest
SHA256 efc181a83d49bde9818fa74c3d019e8eb378afec1d9b248014bc3bff0f786b47
MD5 e94c407a34abdf11b8ee6180e7bcae8a
BLAKE2b-256 75c2070a4542d89df60a2c9dacfc39c284f63e91b8316fffeeea89217c595823

See more details on using hashes here.

File details

Details for the file athina-1.6.12-py3-none-any.whl.

File metadata

  • Download URL: athina-1.6.12-py3-none-any.whl
  • Upload date:
  • Size: 195.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.7.1 CPython/3.9.13 Darwin/23.5.0

File hashes

Hashes for athina-1.6.12-py3-none-any.whl
Algorithm Hash digest
SHA256 e25237b578fad58a4776c9e618d5dc97b2fdbf5bdc2c9ee690e99787b6aec39b
MD5 507e246b1ea3a6a3b09bd026b4a5cfed
BLAKE2b-256 40f2b4fcd8fe9c51fba05a632f338948550ec781bca53cb27fc683041d32fb93

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page