Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.0.91.tar.gz (13.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.0.91-py3-none-any.whl (14.0 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.0.91.tar.gz.

File metadata

  • Download URL: soren-0.0.91.tar.gz
  • Upload date:
  • Size: 13.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.91.tar.gz
Algorithm Hash digest
SHA256 1ce53d738646a592022f295c7490a0765f805934d9dacf579ec5e10d6e085925
MD5 7862e32a7ffbd093c209260b324b17f7
BLAKE2b-256 566961b6c211b0db340a8622abd266817fbcf55a2856be11daba72fe7fc83bdf

See more details on using hashes here.

File details

Details for the file soren-0.0.91-py3-none-any.whl.

File metadata

  • Download URL: soren-0.0.91-py3-none-any.whl
  • Upload date:
  • Size: 14.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.91-py3-none-any.whl
Algorithm Hash digest
SHA256 bddca2e51a53ad46dc09e2061f12996dca7fcea9313f043424d56c0925ad7103
MD5 0da5dc6446f54c47ef1375a9b27df6df
BLAKE2b-256 d641597757c653501185106ba5e835bca3ce10b3368d9d238a1bc7ecd3484200

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page