Skip to main content

Helper functions for the ConfidentialMind stack, primarily for Streamlit apps

Reason this release was yanked:

Package deprecated

Project description

ConfidentialMind App / Playgroundutils

Overview

The ConfidentialMind App package (also known as playgroundutils) is a Python library designed to simplify the development of secure generative AI applications on the ConfidentialMind stack. It provides utility functions and components for building Streamlit-based front-end applications that interact with Large Language Models (LLMs) and other services within the ConfidentialMind ecosystem.

Features

  • Streamlit application initialization and configuration
  • Tool selector for managing multiple tools within a single application
  • Chat UI component for interacting with LLMs
  • Streaming handler for real-time LLM responses
  • User authentication and token management
  • LLM API interaction helpers

Installation

To install the package, add the following to your requirements.txt file:

pip install playgroundutils

Usage

Initializing a Streamlit App

from playgroundutils.app import init_streamlit_app

def main():
    APP_NAME = "My ConfidentialMind App"
    init_streamlit_app(APP_NAME)

    # Your app code here

if __name__ == "__main__":
    main()

Creating a Tool Selector

from playgroundutils.app import tool_selector
from confidentialmindserver.config_manager import BaseToolConfig

def parse_tools_config(tools):
    # Your tool parsing logic here
    pass

tools = [BaseToolConfig(...), BaseToolConfig(...)]
tool_selector(tools, parse_tools_config, APP_NAME)

Implementing a Chat UI

from playgroundutils.components import chat_ui

LLM_CONFIG_ID = "your_llm_config_id"
chat_ui(LLM_CONFIG_ID, system_prompt="You are a helpful assistant.")

Handling LLM API Requests

from playgroundutils.llm_api_helpers import LLMAPIHandler, ChatMessage
from playgroundutils.streaming import StreamHandler

llm_api_handler = LLMAPIHandler(LLM_CONFIG_ID)
stream_handler = StreamHandler(st.empty())

messages = [ChatMessage(role="user", content="Hello, AI!")]
response = llm_api_handler.handle_query(messages, stream_handler, temperature=0.7, stream=True)

Components

  • app.py: Contains functions for initializing Streamlit apps and managing tool selection.
  • components.py: Provides UI components like the chat interface.
  • llm_api_helpers.py: Handles interactions with LLM APIs.
  • streaming.py: Manages streaming responses from LLMs.
  • user.py: Handles user authentication and token management.

Configuration

The package works in conjunction with the ConfidentialMind server package to manage configurations and connectors. Make sure to set up your ConfigManager and define necessary connectors as described in the main ConfidentialMind SDK documentation.

Local Development

To run your Streamlit application locally using this package:

export CONFIDENTIAL_MIND_LOCAL_CONFIG="True"
export CONFIDENTIAL_MIND_LOCAL_DEV="True"
streamlit run your_app.py

Note

This package is designed to work within the ConfidentialMind ecosystem. Make sure you have the necessary permissions and access to the ConfidentialMind stack before using this package.

For more detailed information on the ConfidentialMind SDK and its capabilities, please refer to the main SDK documentation.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

playgroundutils-0.1.1-py3-none-any.whl (341.4 kB view details)

Uploaded Python 3

File details

Details for the file playgroundutils-0.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for playgroundutils-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d149653ddb5c99df76291653e85ce685f1a6482aed26b18ffc4914352d5ad10b
MD5 1e8ea65b26d4ddd54cb199c16c970d91
BLAKE2b-256 fb1351737519cc6ca91754ead382af9e0a9ceeffb3727f922d656a949eccbcee

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page