Skip to main content

Python bindings for Offline Intelligence Library

Project description

Offline Intelligence Python Bindings

Python bindings for the Offline Intelligence Library - High-performance LLM inference engine with memory management capabilities.

Installation

pip install offline-intelligence

Quick Start

from offline_intelligence import Config, run_server

# Configure the engine
config = Config.from_env()

# Start the server
run_server(config)

Features

  • Core LLM Integration: Direct access to LLM engine functionality
  • Memory Management: Base memory operations and database access
  • Configuration: Flexible configuration system
  • Metrics: Performance monitoring and telemetry
  • Proxy Interface: Stream generation and API proxy functionality

Architecture

This package provides bindings to the core open-source components (80%) of the Offline Intelligence system. Proprietary extensions are available separately.

Platform Support

  • Windows (x64)
  • macOS (Intel/Apple Silicon)
  • Linux (x64, ARM64)

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

offline_intelligence-0.1.4.tar.gz (4.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_intelligence-0.1.4-py3-none-any.whl (4.9 kB view details)

Uploaded Python 3

File details

Details for the file offline_intelligence-0.1.4.tar.gz.

File metadata

  • Download URL: offline_intelligence-0.1.4.tar.gz
  • Upload date:
  • Size: 4.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for offline_intelligence-0.1.4.tar.gz
Algorithm Hash digest
SHA256 0c3a83ef58ca608538498ea2019abcfe3c4a30b1dafe4293be4727f6b839f4bf
MD5 60e3be14d1982f435e1afe1e820e9a6f
BLAKE2b-256 23b4ad5ee4d0300069ff8b697690516bcc0fc4266d006b1e934e2725c4a7d184

See more details on using hashes here.

File details

Details for the file offline_intelligence-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for offline_intelligence-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 de3a99c7fdcfc9c4c8df8c6ade9dbd6784b85c20b74ecb441f94b0448ee4b21f
MD5 8ec7cda9e1d1a804e4149616747b0247
BLAKE2b-256 065eddfc36938627b23f194052a4a30c2081a20bd65c94d776d114355373df59

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page