Skip to main content

Soren AI - Command-line interface for AI evaluation framework

Project description

Soren CLI

Command-line interface for the Soren AI evaluation framework.

Installation

pip install soren

Usage

Login

Authenticate with your Soren account:

soren login

You can also provide credentials directly:

soren login --email your@email.com --password yourpassword

Run Evaluations

Create and run an evaluation:

soren run myproject --dataset mydataset --judge gpt-4

Logout

Clear stored credentials:

soren logout

Configuration

The CLI stores configuration in ~/.soren/config.json, including:

  • API key (for authentication)
  • API URL (defaults to production)

Environment Variables

  • SOREN_API_KEY: Set your API key (alternative to soren login)
  • SOREN_API_URL: Override the default API URL

Development

To install from source:

pip install -e .

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soren-0.2.0.tar.gz (15.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

soren-0.2.0-py3-none-any.whl (16.8 kB view details)

Uploaded Python 3

File details

Details for the file soren-0.2.0.tar.gz.

File metadata

  • Download URL: soren-0.2.0.tar.gz
  • Upload date:
  • Size: 15.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.2.0.tar.gz
Algorithm Hash digest
SHA256 fe7c62f7dd599e8fc1fdc1b5f37e73e82a63fe0fa0cdbfb1c49e09ddb7080476
MD5 f06dc05818d40611d60e12003e9de070
BLAKE2b-256 83999f455b33f929f551056841f351e9d5058c82e51726c87890c64831fc4da8

See more details on using hashes here.

File details

Details for the file soren-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: soren-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 16.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for soren-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0170e60d987e6d0300de39d19c81e24f68c3c872864503f21785fb5a83db3521
MD5 13decd5c2885d63c34183edbfc9867cd
BLAKE2b-256 ae9b5de3c9db36aec592a6e16aff9c1651bc0fea55473bed0e1509590699cb7e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page