Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.0.8.tar.gz (13.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.0.8-py3-none-any.whl (13.8 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.0.8.tar.gz.

File metadata

  • Download URL: soren-0.0.8.tar.gz
  • Upload date:
  • Size: 13.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.8.tar.gz
Algorithm Hash digest
SHA256 e6dc1fc3ad7dcade7d31165828fe20ecec6bfcdb4c384bf24468a66ba11f1148
MD5 c120f0b842c933d821d019542ae657c3
BLAKE2b-256 fb38cc481bdd6bb3de2f5a9a831055a0ca7cb92ffc235169137697537208a593

See more details on using hashes here.

File details

Details for the file soren-0.0.8-py3-none-any.whl.

File metadata

  • Download URL: soren-0.0.8-py3-none-any.whl
  • Upload date:
  • Size: 13.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.8-py3-none-any.whl
Algorithm Hash digest
SHA256 5620db302ec2f71b96ab4fe9526c1519eef0b372209a93fa9729a98c84c705a8
MD5 a55800cd41edc732d97447cf61d1808b
BLAKE2b-256 225d237443fc59e17dc878d261f60b3f6e590137eac82488077e5f68f8ba60e8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page