Skip to main content

Python bindings for Offline Intelligence Library

Project description

Offline Intelligence Python Bindings

Python bindings for the Offline Intelligence Library - High-performance LLM inference engine with memory management capabilities.

Installation

pip install offline-intelligence

Quick Start

from offline_intelligence import Config, run_server

# Configure the engine
config = Config.from_env()

# Start the server
run_server(config)

Features

  • Core LLM Integration: Direct access to LLM engine functionality
  • Memory Management: Base memory operations and database access
  • Configuration: Flexible configuration system
  • Metrics: Performance monitoring and telemetry
  • Proxy Interface: Stream generation and API proxy functionality

Architecture

This package provides bindings to the core open-source components (80%) of the Offline Intelligence system. Proprietary extensions are available separately.

Platform Support

  • Windows (x64)
  • macOS (Intel/Apple Silicon)
  • Linux (x64, ARM64)

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

offline_intelligence-0.1.5.tar.gz (4.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_intelligence-0.1.5-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file offline_intelligence-0.1.5.tar.gz.

File metadata

  • Download URL: offline_intelligence-0.1.5.tar.gz
  • Upload date:
  • Size: 4.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for offline_intelligence-0.1.5.tar.gz
Algorithm Hash digest
SHA256 b38403659b3585e2508182000edbd807d63ffa490c2ce3db64a827b1cdae96ac
MD5 3a3750b6a7f7d28c5fbd54e1c837720b
BLAKE2b-256 5abf6849220021fdd610f668b50d3b142acf3894acc47d6794d817fa182c0562

See more details on using hashes here.

File details

Details for the file offline_intelligence-0.1.5-py3-none-any.whl.

File metadata

File hashes

Hashes for offline_intelligence-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 879094c15518e8b3d8e0bf85660e86a3d08e812fa67942c09d01e3534b0ec1ed
MD5 f23cce44d74bf456456963d741bbda1d
BLAKE2b-256 e7bc1612bc7358cd00dfb796aec5bfc986aa6d1cfdb376f55f7e47d804ff9cfa

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page