Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.2.1.tar.gz (20.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.2.1-py3-none-any.whl (22.1 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.2.1.tar.gz.

File metadata

  • Download URL: soren-0.2.1.tar.gz
  • Upload date:
  • Size: 20.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.2.1.tar.gz
Algorithm Hash digest
SHA256 bc6fa6c3a625aacebcbf2dc046ba24577c67f6bd1e58efc8964b5f5df5d7da07
MD5 77da129c09ed3960b22ade851ac41332
BLAKE2b-256 9f38b9b56f55986f27e4faaa72db916d0e9a48eaf8bb9d0c11dabdac914f320d

See more details on using hashes here.

File details

Details for the file soren-0.2.1-py3-none-any.whl.

File metadata

  • Download URL: soren-0.2.1-py3-none-any.whl
  • Upload date:
  • Size: 22.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 18c4180f2c8ad26ffc6c80ca254b3e1a11aec6f5f6b54bd48d15a85edb9c15f8
MD5 0d1b717b5b96997511e594c24b5685ad
BLAKE2b-256 22d305f56a8de5a362f584f502c5c715ed2a7131fd1a5721cff6e24336da15e4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page