Python SDK to configure and run evaluations for your LLM-based application

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers
Report project as malware

Project description

Overview

Athina is an Observability and Experimentation platform for AI teams.

This SDK is an open-source repository of 50+ preset evals. You can also use custom evals.

This SDK also serves as a companion to Athina IDE where you can prototype pipelines, run experiments and evaluations, and compare datasets.

Quick Start

Follow this notebook for a quick start guide.

To get an Athina API key, sign up at https://app.athina.ai

Run Evals

These evals can be run programmatically, or via the UI on Athina IDE.

image

Compare datasets side-by-side (Docs)

Once a dataset is logged to Athina IDE, you can also compare it against another dataset.

image

Once you run evals using Athina, they will be visible in Athina IDE where you can run experiments, evals, and compare datasets side-by-side.

Preset Evals

Athina Steps

To use CodeExecutionV2, you need to install e2b.

pip install e2b-code-interpreter

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for magik from gravatar.com magik

Unverified details

These details have not been verified by PyPI
Meta
Classifiers

Release history Release notifications | RSS feed

This version

1.7.39

1.7.38

1.7.37

1.7.36

1.7.35

1.7.34

1.7.33

1.7.32

1.7.31

1.7.30

1.7.29

1.7.28

1.7.27

1.7.26

1.7.25

1.7.24

1.7.23

1.7.22

1.7.21

1.7.20

1.7.19

1.7.18

1.7.17

1.7.16

1.7.15

1.7.14

1.7.13

1.7.12

1.7.11

1.7.10

1.7.9

1.7.8

1.7.7

1.7.6

1.7.5

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.33

1.6.32

1.6.31

1.6.30

1.6.29 yanked

1.6.28

1.6.27

1.6.26

1.6.25

1.6.24

1.6.23

1.6.22

1.6.21

1.6.20

1.6.19

1.6.18

1.6.17

1.6.16

1.6.15

1.6.14

1.6.13

1.6.12

1.6.11

1.6.10

1.6.9

1.6.8

1.6.7

1.6.6

1.6.5

1.6.4

1.6.3

1.6.2

1.6.1

1.6.0

1.5.30

1.5.29

1.5.28

1.5.27

1.5.26

1.5.25

1.5.24

1.5.23

1.5.22

1.5.21

1.5.20

1.5.19

1.5.18

1.5.17

1.5.16

1.5.15

1.5.14

1.5.13

1.5.12

1.5.11

1.5.10

1.5.9

1.5.8

1.5.7

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.28

1.4.27

1.4.26

1.4.25

1.4.24

1.4.22

1.4.21

1.4.20

1.4.19

1.4.18

1.4.17

1.4.16

1.4.15

1.4.14

1.4.13

1.4.12

1.4.11

1.4.10

1.4.9

1.4.8

1.4.7

1.4.6

1.4.5

1.4.4

1.4.3

1.4.2

1.4.1

1.4.0

1.3.3

1.3.2

1.3.1

1.3.0

1.2.19

1.2.18

1.2.17

1.2.16

1.2.15

1.2.14

1.2.13

1.2.12

1.2.11

1.2.10

1.2.9

1.2.8

1.2.7

1.2.6

1.2.5

1.2.4

1.2.3

1.2.2

1.2.1

1.2.0

1.1.5

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.0

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

athina-1.7.39.tar.gz (149.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

athina-1.7.39-py3-none-any.whl (230.1 kB view details)

Uploaded Python 3

File details

Details for the file athina-1.7.39.tar.gz.

File metadata

  • Download URL: athina-1.7.39.tar.gz
  • Upload date:
  • Size: 149.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.13.3 Linux/6.11.0-1014-azure

File hashes

Hashes for athina-1.7.39.tar.gz
Algorithm Hash digest
SHA256 47bd77fe9e00e924b8d0431ffbe1f6ed4a17576065a58aeee9004fc14949724d
MD5 6711f099e162c7f7ca2da5c8be131c7e
BLAKE2b-256 ba12fd77bcfaeda6fc969665b4e77dfd4b4b956e84333365743964de7fa7013c

See more details on using hashes here.

File details

Details for the file athina-1.7.39-py3-none-any.whl.

File metadata

  • Download URL: athina-1.7.39-py3-none-any.whl
  • Upload date:
  • Size: 230.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.13.3 Linux/6.11.0-1014-azure

File hashes

Hashes for athina-1.7.39-py3-none-any.whl
Algorithm Hash digest
SHA256 4db2d176107bf3d0867113f01f965ac22a0f786fea15ecbc24bc4b1982703a75
MD5 5ab7f224b5708e18bacb0f8b52305afc
BLAKE2b-256 21095c33db9c2b981e8d6aa10afdf73e12c4405d0524ef3c41cf7b0d91e1b5ca

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page