Skip to main content

Prompt Perfection at Your Fingertips

Project description

LLMstudio by TensorOps

Prompt Engineering at your fingertips

LLMstudio logo

🌟 Features

LLMstudio UI

  • LLM Proxy Access: Seamless access to all the latest LLMs by OpenAI, Anthropic, Google.
  • Custom and Local LLM Support: Use custom or local open-source LLMs through Ollama.
  • Prompt Playground UI: A user-friendly interface for engineering and fine-tuning your prompts.
  • Python SDK: Easily integrate LLMstudio into your existing workflows.
  • Monitoring and Logging: Keep track of your usage and performance for all requests.
  • LangChain Integration: LLMstudio integrates with your already existing LangChain projects.
  • Batch Calling: Send multiple requests at once for improved efficiency.
  • Smart Routing and Fallback: Ensure 24/7 availability by routing your requests to trusted LLMs.
  • Type Casting (soon): Convert data types as needed for your specific use case.

🚀 Quickstart

Don't forget to check out https://docs.llmstudio.ai page.

Installation

Install the latest version of LLMstudio using pip. We suggest that you create and activate a new environment using conda

pip install llmstudio

Install bun if you want to use the UI

curl -fsSL https://bun.sh/install | bash

Create a .env file at the same path you'll run LLMstudio

OPENAI_API_KEY="sk-api_key"
ANTHROPIC_API_KEY="sk-api_key"

Now you should be able to run LLMstudio using the following command.

llmstudio server --ui

When the --ui flag is set, you'll be able to access the UI at http://localhost:3000

📖 Documentation

👨‍💻 Contributing

  • Head on to our Contribution Guide to see how you can help LLMstudio.
  • Join our Discord to talk with other LLMstudio enthusiasts.

Training

Banner


Thank you for choosing LLMstudio. Your journey to perfecting AI interactions starts here.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmstudio-0.3.12a7.tar.gz (115.1 kB view details)

Uploaded Source

Built Distribution

llmstudio-0.3.12a7-py3-none-any.whl (165.7 kB view details)

Uploaded Python 3

File details

Details for the file llmstudio-0.3.12a7.tar.gz.

File metadata

  • Download URL: llmstudio-0.3.12a7.tar.gz
  • Upload date:
  • Size: 115.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for llmstudio-0.3.12a7.tar.gz
Algorithm Hash digest
SHA256 c76ddec45ab53da0a025607e563d6140afbbb72e7cb6ea5b25585d3d4c16a507
MD5 588adb9505849410951f0e7233e31ef0
BLAKE2b-256 837cd20bd0994b5940cb4a80b8e0b13d82bce527fa144a12d177821b84babb1b

See more details on using hashes here.

File details

Details for the file llmstudio-0.3.12a7-py3-none-any.whl.

File metadata

  • Download URL: llmstudio-0.3.12a7-py3-none-any.whl
  • Upload date:
  • Size: 165.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.4 CPython/3.12.7 Linux/6.5.0-1025-azure

File hashes

Hashes for llmstudio-0.3.12a7-py3-none-any.whl
Algorithm Hash digest
SHA256 6f207630903955a11c87d8be6091afc6e05dc746767bb2adf7035feaf8ed3789
MD5 e98ace56f6565ebd0517ef27cddf04be
BLAKE2b-256 baba6b62d89cf8b344c090ac4f7ca75b9156b42b62b4bfd07fc24f39b79b6ceb

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page