Skip to main content

No project description provided

Project description

pharia-inference-sdk

Formally the intelligence_layer/core package.

Overview

The pharia-inference-sdk provides essential functionality for the intelligence layer. TBD

Installation

The SDK is published on PyPI.

To add the SDK as a dependency to an existing project managed, run

pip install pharia-inference-sdk

Usage

from pharia_inference_sdk.core.tracer import InMemoryTracer
from pharia_inference_sdk.core.model import Llama3InstructModel
from pharia_inference_sdk.connectors import LimitedConcurrencyClient

client = LimitedConcurrencyClient()
model = Llama3InstructModel(client=client)
tracer = InMemoryTracer()

prompt = "Hello, world!"

model.generate(prompt, tracer)

Contributing

We welcome contributions! Please see our Contributing Guide for details on how to set up the development environment and submit changes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pharia_inference_sdk-0.1.0.tar.gz (36.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pharia_inference_sdk-0.1.0-py3-none-any.whl (44.3 kB view details)

Uploaded Python 3

File details

Details for the file pharia_inference_sdk-0.1.0.tar.gz.

File metadata

File hashes

Hashes for pharia_inference_sdk-0.1.0.tar.gz
Algorithm Hash digest
SHA256 04e9c5c91a3eaac17366ab7ec4c31d0ce0798abab91dd35bd7b6188338a24332
MD5 3c8688039a7c3844a40eba1f18bcb6e2
BLAKE2b-256 50ddde41dde98d39d9b81c41902746970f66f292cdaacbea239f755566f9f5e0

See more details on using hashes here.

File details

Details for the file pharia_inference_sdk-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for pharia_inference_sdk-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cb8b7313b5b45478870c4e1620bf8c688cfec1e911b07867a4f91cd110d023fc
MD5 de63a6ea232596bdc72f8bfb62592365
BLAKE2b-256 2fc365245a08df76a7b3932aa419ffcd29e23d511794b44b6e40a59bb101653a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page