Skip to main content

Python bindings for Offline Intelligence Library

Project description

Offline Intelligence Python Bindings

Python bindings for the Offline Intelligence Library - High-performance LLM inference engine with memory management capabilities.

Installation

pip install offline-intelligence

Quick Start

from offline_intelligence import Config, run_server

# Configure the engine
config = Config.from_env()

# Start the server
run_server(config)

Features

  • Core LLM Integration: Direct access to LLM engine functionality
  • Memory Management: Base memory operations and database access
  • Configuration: Flexible configuration system
  • Metrics: Performance monitoring and telemetry
  • Proxy Interface: Stream generation and API proxy functionality

Architecture

This package provides bindings to the core open-source components (80%) of the Offline Intelligence system. Proprietary extensions are available separately.

Platform Support

  • Windows (x64)
  • macOS (Intel/Apple Silicon)
  • Linux (x64, ARM64)

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_intelligence-0.1.3-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file offline_intelligence-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for offline_intelligence-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 bba191094ebebc28d5a0bb51e99ac7b8c20baa2cf93ae5bce8374ee46be235d3
MD5 564b461eab1cca815e85a1c373c8270d
BLAKE2b-256 042af59482ba7406bb6c31667b4edc3eac0c3d5ac75c56b85a12d71bd43b62b3

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page