Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.0.3.tar.gz (8.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.0.3-py3-none-any.whl (8.3 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.0.3.tar.gz.

File metadata

  • Download URL: soren-0.0.3.tar.gz
  • Upload date:
  • Size: 8.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.3.tar.gz
Algorithm Hash digest
SHA256 50721bcbf7deb0eb604bada78d51e9a75cda326931ba022b991e05a44d1fb2b5
MD5 45508b6e426c4a6750cec7540a96c040
BLAKE2b-256 785909406170a7b212f62dc30713474e5cf7abe6b8508ff8e48ee6ff62bb87dd

See more details on using hashes here.

File details

Details for the file soren-0.0.3-py3-none-any.whl.

File metadata

  • Download URL: soren-0.0.3-py3-none-any.whl
  • Upload date:
  • Size: 8.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 79c9fca9a16ffeb591a63bd499404604a18252d9a2830e93f065eb885cc8dcaa
MD5 ee3296776def9f620783313f6ea2931b
BLAKE2b-256 f8eeb5509e0949d05f77892461ab2a8703c9480d3e8bf065f84f85fcee3f80d0

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page