Skip to main content

Quilr Guardrails Integration for LiteLLM

Project description

Using Quilr Guardrails with Litellm

Prerequisites

  • Quilr API Key from Quilr guardrails (from either self hosted Quilr guardrails or Quilr hosted)

Using with litellm

  • Add the following to your litellm config.yaml file
guardrails:
- guardrail_name: "quilr-input"
    litellm_params:
    guardrail: quilr_litellm_guardrails.QuilrGuardrail
    mode: "pre_call"

- guardrail_name: "quilr-output"
    litellm_params:
    guardrail: quilr_litellm_guardrails.QuilrGuardrail
    mode: "post_call"
  • Set the following environment variables
QUILR_GUARDRAILS_KEY=sk-quilr-XXXXXXXXX
QUILR_GUARDRAILS_BASE_URL=QUILR GUARDRAILS BASE URL

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

quilr_litellm_guardrails-0.1.0.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

quilr_litellm_guardrails-0.1.0-py3-none-any.whl (4.2 kB view details)

Uploaded Python 3

File details

Details for the file quilr_litellm_guardrails-0.1.0.tar.gz.

File metadata

File hashes

Hashes for quilr_litellm_guardrails-0.1.0.tar.gz
Algorithm Hash digest
SHA256 d52281816c5b6aec7137b8bb22f652bc1095f3754df8986cba6db3c9e8d03ba5
MD5 cd9e15f4c38c56da7f62adc04f38ba4e
BLAKE2b-256 97fc384d2b2500a00a1a6483693dd4f35e5c47ffa19914a65aae023a0d8c4bdd

See more details on using hashes here.

File details

Details for the file quilr_litellm_guardrails-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for quilr_litellm_guardrails-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2525e8b3643d05821752d14c7fa8333e0c045a4316422b0ade6cfcfd8d32d590
MD5 128738e24e539dd1eae15f3980bd1fef
BLAKE2b-256 ec02c2fe166b92a9eadac8f6a5d75ff948bab0b53cee3bffe98c77c46d1f05ad

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page