Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Swarmauri

Downloads Hits Python License Release

Swarmauri NVIDIA NIM LLM

swarmauri_llm_nvidia_nim connects Swarmauri conversations and toolkits to an NVIDIA NIM for LLMs deployment.

Features

  • OpenAI-compatible chat completions through NvidiaNIMModel.
  • Tool calling through NvidiaNIMToolModel.
  • Synchronous, asynchronous, incremental streaming, and batch workflows inherited from Swarmauri's shared transports.
  • Optional discovery from the deployment's /v1/models endpoint.
  • Configurable deployment base URL for local, private, and managed NIM endpoints.
  • Persistent, injectable Swarmauri HTTP clients with conservative rate-limit retries.

Installation

uv add swarmauri_llm_nvidia_nim
pip install swarmauri_llm_nvidia_nim

Usage

from swarmauri_llm_nvidia_nim import NvidiaNIMModel
from swarmauri_standard.conversations.Conversation import Conversation
from swarmauri_standard.messages.HumanMessage import HumanMessage

conversation = Conversation(messages=[HumanMessage(content="What is accelerated computing?")])
model = NvidiaNIMModel(
    base_url="http://localhost:8000",
    name="meta/llama-3.1-8b-instruct",
)
model.predict(conversation)
print(conversation.get_last().content)

Pass api_key when the deployment requires bearer authentication. Set discover_models=True to populate allowed_models from the running deployment. For tool workflows, instantiate NvidiaNIMToolModel and pass a Swarmauri Toolkit to predict, apredict, stream, or astream.

Pass an IHttpClient as http_client to integrate a custom transport or to test without network access. Pass an IHttpRetryPolicy as retry_policy to replace the default policy, which retries safe reads and rate-limited chat submissions without replaying failed POST requests for generic server errors.

See the NVIDIA NIM LLM API reference for deployment and model-specific capability details.

Metadata

Release files for swarmauri_llm_nvidia_nim 0.11.0.dev3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for swarmauri_llm_nvidia_nim 0.11.0.dev3
File Size Uploaded Provenance Actions
swarmauri_llm_nvidia_nim-0.11.0.dev3.tar.gz 4.3 kB Without provenance Details for swarmauri_llm_nvidia_nim-0.11.0.dev3.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for swarmauri_llm_nvidia_nim 0.11.0.dev3
File Interpreter ABI Platform Actions
swarmauri_llm_nvidia_nim-0.11.0.dev3-py3-none-any.whl Python 3 none any Details for swarmauri_llm_nvidia_nim-0.11.0.dev3-py3-none-any.whl

Total release size: 11.6 kB

Release files / swarmauri_llm_nvidia_nim-0.11.0.dev3.tar.gz

Download URL swarmauri_llm_nvidia_nim-0.11.0.dev3.tar.gz
Size 4.3 kB
Tags Source
SHA-256 checksum
How to use checksums
201f0c50fddcb378c40da63ca00276ee281f629cb2dc37e8b4a1f34b58113ec9
BLAKE2b-256 checksum
How to use checksums
ed286273555108f8584c6a6999fcba185a1a7603d0c8766f95710f897f33ca9f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.9 {"installer":{"name":"uv","version":"0.13.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / swarmauri_llm_nvidia_nim-0.11.0.dev3-py3-none-any.whl

Download URL swarmauri_llm_nvidia_nim-0.11.0.dev3-py3-none-any.whl
Size 7.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f5cc430bca28924771c31eb6acd3b801bca0d0ae99598d13847ec51d7581f6a1
BLAKE2b-256 checksum
How to use checksums
05310174f453504b1076eae13a83fdf0f21cfd0d8622bff493eebeffe7457c16
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.9 {"installer":{"name":"uv","version":"0.13.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for swarmauri_llm_nvidia_nim 0.11.0.dev3

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page