Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.0.9.tar.gz (13.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.0.9-py3-none-any.whl (13.9 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.0.9.tar.gz.

File metadata

  • Download URL: soren-0.0.9.tar.gz
  • Upload date:
  • Size: 13.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.9.tar.gz
Algorithm Hash digest
SHA256 b199988dba0a44f3d1cde94cbfe2707c0dc71c4e25d3f3b02776525f5dff8e2d
MD5 47fa9a88fbad6da85996238c919d95a0
BLAKE2b-256 1a0a8c15bc8d99ab449605646c0d32dbdc42efe19b2b3d02ba400f4b15b75bd7

See more details on using hashes here.

File details

Details for the file soren-0.0.9-py3-none-any.whl.

File metadata

  • Download URL: soren-0.0.9-py3-none-any.whl
  • Upload date:
  • Size: 13.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 8df6ee460bbc856e531a0b596b9882cde90a22051409e339a6790ef55a3cfb58
MD5 bc79fbeb9cc945ad31305e7a41986250
BLAKE2b-256 281bf0c2d39f2ad013fa96bfd84cfa4949e9e084dc9b40b85ecef92b83a5f3e4

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page