Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.0.2.tar.gz (4.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.0.2-py3-none-any.whl (5.3 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.0.2.tar.gz.

File metadata

  • Download URL: soren-0.0.2.tar.gz
  • Upload date:
  • Size: 4.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for soren-0.0.2.tar.gz
Algorithm Hash digest
SHA256 2dc003e332894af52d96c2cd5766a45f14d92752472aaf0523981e4d27145b7a
MD5 5948c6be88e5f37279ecad4eb6f60f04
BLAKE2b-256 66c3495ba22a741ff0b3fd7e558211037a819fb7a8b3f1d514c5728df372f9cc

See more details on using hashes here.

File details

Details for the file soren-0.0.2-py3-none-any.whl.

File metadata

  • Download URL: soren-0.0.2-py3-none-any.whl
  • Upload date:
  • Size: 5.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.9.6

File hashes

Hashes for soren-0.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 6783622632677d1806c694e98aa8373dde181e2ffea8e7bdc6ad90da32e9bfc5
MD5 72b64e09a6d02f1e4222716c3ae116a2
BLAKE2b-256 7f4d52101d58d4a5fa051c70eca2cc6b1462a11fffd192701ed39b779270f55a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page