Skip to main content

"LM-Proxy" is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

Project description

PYPI Release Code Style Tests License

LM-Proxy

LM-Proxy is OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.

Development Status: bookmark it and go away, it is still in early development.

✨ Features

  • @todo

🚀 Quickstart

# Install LM-Proxy via pip
pip install lm-proxy

🤝 Contributing

We ❤️ contributions! See CONTRIBUTING.md.

📝 License

Licensed under the MIT License.

© 2022—2025 Vitalii Stepanenko

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lm_proxy-0.2.0.tar.gz (6.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lm_proxy-0.2.0-py3-none-any.whl (9.1 kB view details)

Uploaded Python 3

File details

Details for the file lm_proxy-0.2.0.tar.gz.

File metadata

  • Download URL: lm_proxy-0.2.0.tar.gz
  • Upload date:
  • Size: 6.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for lm_proxy-0.2.0.tar.gz
Algorithm Hash digest
SHA256 d4babed9c47aa64bb0b067db34a47233b06e2400c876ad5fa2a1f8ead186df5e
MD5 fabe2d9d606e99fd726a0d983ef66881
BLAKE2b-256 ca2fce376ba9b37cfb3faa2c482065a799ee4b15ca9da51ee8e35d070994888a

See more details on using hashes here.

File details

Details for the file lm_proxy-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: lm_proxy-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 9.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.1

File hashes

Hashes for lm_proxy-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 ed31344b900d9b64003cf70e537b23099bfbaaffbf13f280a8b76b77636af067
MD5 6e78f88bbadfb310be48ca91fe069e19
BLAKE2b-256 f0b1fca87a7aea215a8e3eebe8a7f555733445abbe56a6f6a67a4b9bcd2449b1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page