Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.1.0.tar.gz (13.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.1.0-py3-none-any.whl (14.4 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.1.0.tar.gz.

File metadata

  • Download URL: soren-0.1.0.tar.gz
  • Upload date:
  • Size: 13.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.1.0.tar.gz
Algorithm Hash digest
SHA256 af897aa442e7b25b1462c15e63e5203f0ba73730dc29f3937b27ee67e978dac5
MD5 cb01c1ecedc575f5f41e7bd942d414a4
BLAKE2b-256 c288662d5a231a6e41c5d47827a9baedc0a885de8278fb2c6f0daed73cceafa5

See more details on using hashes here.

File details

Details for the file soren-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: soren-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 14.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 07bff235f366050eef59305fdb67202b71b3fe709232397800c3fdacf21a3e85
MD5 85157be58e38d36d87d6f3a63ee08d78
BLAKE2b-256 295e93267a9e7b96b85ddeff865671e9d4cafc37a486548defcb16ff859740f2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page