Skip to main content

Python bindings for Offline Intelligence Library

Project description

Offline Intelligence Python Bindings

Python bindings for the Offline Intelligence Library - High-performance LLM inference engine with memory management capabilities.

Installation

pip install offline-intelligence

Quick Start

from offline_intelligence import Config, run_server

# Configure the engine
config = Config.from_env()

# Start the server
run_server(config)

Features

  • Core LLM Integration: Direct access to LLM engine functionality
  • Memory Management: Base memory operations and database access
  • Configuration: Flexible configuration system
  • Metrics: Performance monitoring and telemetry
  • Proxy Interface: Stream generation and API proxy functionality

Architecture

This package provides bindings to the core open-source components (80%) of the Offline Intelligence system. Proprietary extensions are available separately.

Platform Support

  • Windows (x64)
  • macOS (Intel/Apple Silicon)
  • Linux (x64, ARM64)

License

Apache 2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

offline_intelligence-0.1.6.tar.gz (4.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

offline_intelligence-0.1.6-py3-none-any.whl (4.7 kB view details)

Uploaded Python 3

File details

Details for the file offline_intelligence-0.1.6.tar.gz.

File metadata

  • Download URL: offline_intelligence-0.1.6.tar.gz
  • Upload date:
  • Size: 4.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for offline_intelligence-0.1.6.tar.gz
Algorithm Hash digest
SHA256 c45ecd185b3fb02d6d87ca3cf7442d7e7fa83d99e66c8b5b9da997ca080698c4
MD5 6b254114467c059a3be9df5b19bf46c1
BLAKE2b-256 9dfa47e057df7325eb7f8538c01653d15f95b16bbd63a5ec358228dbde197d4b

See more details on using hashes here.

File details

Details for the file offline_intelligence-0.1.6-py3-none-any.whl.

File metadata

File hashes

Hashes for offline_intelligence-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 043b5fdfc820c7722fcdab656675c6e864cdc2529ae306a49a5e31a708a4fab3
MD5 a0300ec4f6a21a807bcc915a39e2eeef
BLAKE2b-256 929cb0092ea039a318c93be8ddaf0d0335eb4e1f87dd861950bc9dd8fec7de09

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page