Skip to main content

No project description provided

Project description

pharia-inference-sdk

Formally the intelligence_layer/core package.

Overview

The pharia-inference-sdk provides essential functionality for the intelligence layer. TBD

Installation

The SDK is published on PyPI.

To add the SDK as a dependency to an existing project managed, run

pip install pharia-inference-sdk

Usage

from pharia_inference_sdk.core.tracer import InMemoryTracer
from pharia_inference_sdk.core.model import Llama3InstructModel
from pharia_inference_sdk.connectors import LimitedConcurrencyClient

client = LimitedConcurrencyClient()
model = Llama3InstructModel(client=client)
tracer = InMemoryTracer()

prompt = "Hello, world!"

model.generate(prompt, tracer)

Contributing

We welcome contributions! Please see our Contributing Guide for details on how to set up the development environment and submit changes.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pharia_inference_sdk-0.1.2.tar.gz (36.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

pharia_inference_sdk-0.1.2-py3-none-any.whl (44.3 kB view details)

Uploaded Python 3

File details

Details for the file pharia_inference_sdk-0.1.2.tar.gz.

File metadata

File hashes

Hashes for pharia_inference_sdk-0.1.2.tar.gz
Algorithm Hash digest
SHA256 b9fc5fa4acffc76e50c525e12f3e0e51767afaa59608bcad74668378faddcd3f
MD5 6ce150084a5d72694ad58f57d970f912
BLAKE2b-256 04b4ffef7d6a0c9d145f771f319ee222a145b4a455e501e4fd2d9d028f1b8d93

See more details on using hashes here.

File details

Details for the file pharia_inference_sdk-0.1.2-py3-none-any.whl.

File metadata

File hashes

Hashes for pharia_inference_sdk-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 3f58134d6d9be7b0e44383aec1b4a2d823de760109e90e2a2da2b98c9a982d42
MD5 2f3dc196b712d18eb39a7dfa72dd6398
BLAKE2b-256 172cadcb58c3db4ac80ba31b596584d94adf88be4ca0f7da4fd650507f512f60

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page