Skip to main content

LLM Sniffer - OpenAI-compatible reverse proxy with request/response inspector

Project description

LLM Sniffer

LLM Sniffer is an OpenAI-compatible reverse proxy with request/response inspector.

Features

  • Reverse Proxy: OpenAI-compatible API proxy
  • Request/Response Inspector: Monitor and inspect all LLM requests and responses
  • SSE Support: Server-Sent Events for streaming responses
  • Modern UI: Clean web interface for inspecting traffic

Installation

pip install llm-sniffer

Usage

Start the proxy server:

llm-sniffer

Configure your LLM client to use:

http://127.0.0.1:8000/v1

Then open http://127.0.0.1:8000 in your browser to inspect requests.

Configuration

Default port is 8000. You can customize the port in the config file.

License

MIT License

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_sniffer-0.1.0.tar.gz (20.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_sniffer-0.1.0-py3-none-any.whl (21.3 kB view details)

Uploaded Python 3

File details

Details for the file llm_sniffer-0.1.0.tar.gz.

File metadata

  • Download URL: llm_sniffer-0.1.0.tar.gz
  • Upload date:
  • Size: 20.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.2

File hashes

Hashes for llm_sniffer-0.1.0.tar.gz
Algorithm Hash digest
SHA256 ebbe65d802b418cf4d84cf5adb45038f1299dbb789f4adef2c469b0e87c9b2cb
MD5 a67a5eeda7bb06d11010ba890ccaa2e4
BLAKE2b-256 0973b1531ce940fd39f1a061717d9aac9311340670fb855959eea320606a3d41

See more details on using hashes here.

File details

Details for the file llm_sniffer-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llm_sniffer-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 21.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.2

File hashes

Hashes for llm_sniffer-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 49f97cbbbf7b85c3e524d11ee29621ca17f7e24777ec2733a05f8d58c2f98802
MD5 e059ccfbcfcdf1ed83f95c4975900b4a
BLAKE2b-256 eb97f2b999428cdc194d0c746e61adbd5ffe52fdcdb0f2767ec033e5e34a4328

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page