Skip to main content

superduper_llamacpp

Superduper allows users to work with self-hosted LLM models via Llama.cpp.

Installation

pip install superduper_llamacpp

API

Class Description
superduper_llamacpp.model.LlamaCpp Llama.cpp connector.
superduper_llamacpp.model.LlamaCppEmbedding Llama.cpp connector for embeddings.

Examples

LlamaCpp

from superduper_llama_cpp.model import LlamaCpp

model = LlamaCpp(
    identifier="llm",
    model_name_or_path="mistral-7b-instruct-v0.2.Q4_K_M.gguf",
)
model.predict("Hello world")

Metadata

Release files for superduper-llamacpp 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for superduper-llamacpp 0.10.0
File Size Uploaded
superduper_llamacpp-0.10.0.tar.gz 12.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for superduper-llamacpp 0.10.0
File Interpreter ABI Platform
superduper_llamacpp-0.10.0-py3-none-any.whl Python 3 none any Details

Total release size: 23.3 kB

Release files / superduper_llamacpp-0.10.0.tar.gz

Download URL superduper_llamacpp-0.10.0.tar.gz
Size 12.0 kB
Tags Source
SHA-256 checksum
How to use checksums
82276c849133689184701d0884f57d1cb8ba5a459f83c9d80aee2bbaa5d9d9bf
BLAKE2b-256 checksum
How to use checksums
64567dea432a3e1eaa9d28aaa6c1fac68682a2e34aa50d794ff10fd092a4ef61
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.12.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 26, 2025.

Transparency log

Release files / superduper_llamacpp-0.10.0-py3-none-any.whl

Download URL superduper_llamacpp-0.10.0-py3-none-any.whl
Size 11.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
fb421c04a542cd0b1aceeaf184b39bac9b7f702ba3f4541dfa1e382d8c5bc330
BLAKE2b-256 checksum
How to use checksums
ce6b7bb69536e1b9e16362970ed03bdd927622876c25dc2d0f043eeb72712c80
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/6.1.0 CPython/3.12.9

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Aug 26, 2025.

Transparency log

Release history Release notifications | RSS feed

This release

0.10.0 This release

2 release files

0.9.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.0.5

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page