Skip to main content

High performance client for Baseten.co

This library provides a high-performance Python client for Baseten.co endpoints including embeddings, reranking, and classification. It was built for massive concurrent post requests to any URL, also outside of baseten.co. PerformanceClient releases the GIL while performing requests in the Rust, and supports simultaneous sync and async usage. It was benchmarked with >1200 rps per client in our blog. PerformanceClient is built on top of pyo3, reqwest and tokio and is MIT licensed.

benchmarks

Installation

pip install baseten_performance_client

Usage

import os
import asyncio
from baseten_performance_client import PerformanceClient, OpenAIEmbeddingsResponse, RerankResponse, ClassificationResponse

api_key = os.environ.get("BASETEN_API_KEY")
base_url_embed = "https://model-yqv4yjjq.api.baseten.co/environments/production/sync"
# Also works with OpenAI or Mixedbread.
# base_url_embed = "https://api.openai.com" or "https://api.mixedbread.com"

# Basic client setup
client = PerformanceClient(base_url=base_url_embed, api_key=api_key)

# Advanced setup with HTTP version selection and connection pooling
from baseten_performance_client import HttpClientWrapper
http_wrapper = HttpClientWrapper(http_version=1)  # HTTP/1.1 (default)
advanced_client = PerformanceClient(
    base_url=base_url_embed,
    api_key=api_key,
    http_version=1,  # HTTP/1.1
    client_wrapper=http_wrapper  # Share connection pool
)

Embeddings

Synchronous Embedding

from baseten_performance_client import RequestProcessingPreference

texts = ["Hello world", "Example text", "Another sample"]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
response = client.embed(
    input=texts,
    model="my_model",
    preference=preference
)

# Accessing embedding data
print(f"Model used: {response.model}")
print(f"Total tokens used: {response.usage.total_tokens}")
print(f"Total time: {response.total_time:.4f}s")
if response.individual_batch_request_times:
    for i, batch_time in enumerate(response.individual_batch_request_times):
        print(f"  Time for batch {i}: {batch_time:.4f}s")

for i, embedding_data in enumerate(response.data):
    print(f"Embedding for text {i} (original input index {embedding_data.index}):")
    # embedding_data.embedding can be List[float] or str (base64)
    if isinstance(embedding_data.embedding, list):
        print(f"  First 3 dimensions: {embedding_data.embedding[:3]}")
        print(f"  Length: {len(embedding_data.embedding)}")

# Using the numpy() method (requires numpy to be installed)
import numpy as np
numpy_array = response.numpy()
print("\nEmbeddings as NumPy array:")
print(f"  Shape: {numpy_array.shape}")
print(f"  Data type: {numpy_array.dtype}")
if numpy_array.shape[0] > 0:
    print(f"  First 3 dimensions of the first embedding: {numpy_array[0][:3]}")

Note: The embed method is versatile and can be used with any embeddings service, e.g. OpenAI API embeddings, not just for Baseten deployments.

Asynchronous Embedding

async def async_embed():
    from baseten_performance_client import RequestProcessingPreference

    texts = ["Async hello", "Async example"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_embed(
        input=texts,
        model="my_model",
        preference=preference
    )
    print("Async embedding response:", response.data)

# To run:
# asyncio.run(async_embed())

Embedding Benchmarks

Comparison against pip install openai for /v1/embeddings. Tested with the ./scripts/compare_latency_openai.py with mini_batch_size of 128, and 4 server-side replicas. Results with OpenAI similar, OpenAI allows a max mini_batch_size of 2048.

Number of inputs / embeddings Number of Tasks PerformanceClient (s) AsyncOpenAI (s) Speedup
128 1 0.12 0.13 1.08×
512 4 0.14 0.21 1.50×
8 192 64 0.83 1.95 2.35×
131 072 1 024 4.63 39.07 8.44×
2 097 152 16 384 70.92 903.68 12.74×

General Batch POST

The batch_post method is generic. It can be used to send POST requests to any URL, not limited to Baseten endpoints. The input and output can be any JSON item.

Synchronous Batch POST

from baseten_performance_client import RequestProcessingPreference

payload1 = {"model": "my_model", "input": ["Batch request sample 1"]}
payload2 = {"model": "my_model", "input": ["Batch request sample 2"]}
preference = RequestProcessingPreference(
    max_concurrent_requests=32,
    timeout_s=360,
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360,  # Total operation timeout
    extra_headers={"x-custom-header": "value"}  # Custom headers
)
response_obj = client.batch_post(
    url_path="/v1/embeddings", # Example path, adjust to your needs
    payloads=[payload1, payload2],
    preference=preference
)
print(f"Total time for batch POST: {response_obj.total_time:.4f}s")
for i, (resp_data, headers, time_taken) in enumerate(zip(response_obj.data, response_obj.response_headers, response_obj.individual_request_times)):
    print(f"Response {i+1}:")
    print(f"  Data: {resp_data}")
    print(f"  Headers: {headers}")
    print(f"  Time taken: {time_taken:.4f}s")

Pre-encoded JSON payloads

A payload can also be bytes holding UTF-8 JSON. The client sends those bytes unchanged, byte for byte, and skips the Python-to-JSON conversion, which otherwise runs while holding the GIL. Use this for large payloads that you already hold as bytes or encode elsewhere. bytes and regular objects can be mixed in one call; invalid JSON raises ValueError.

import orjson

response_obj = client.batch_post(
    url_path="/v1/embeddings",
    payloads=[orjson.dumps(payload1), payload2],
)

Raw response bytes

With raw_bytes=True, each item of response_obj.data is the response body as bytes instead of a Python object. The client asks the server for JSON only and skips the conversion to Python objects, which otherwise runs while holding the GIL. Use this for large responses that you parse selectively.

import orjson

response_obj = client.batch_post(
    url_path="/v1/embeddings",
    payloads=[orjson.dumps(payload1), payload2],
    raw_bytes=True,
)
first = orjson.loads(response_obj.data[0])

Asynchronous Batch POST

async def async_batch_post_example():
    from baseten_performance_client import RequestProcessingPreference

    payload1 = {"model": "my_model", "input": ["Async batch sample 1"]}
    payload2 = {"model": "my_model", "input": ["Async batch sample 2"]}
preference = RequestProcessingPreference(
    max_concurrent_requests=32,
    timeout_s=360,
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360,  # Total operation timeout
    extra_headers={"x-custom-header": "value"}  # Custom headers
)
    response_obj = await client.async_batch_post(
        url_path="/v1/embeddings",
        payloads=[payload1, payload2],
        preference=preference
    )
    print(f"Async total time for batch POST: {response_obj.total_time:.4f}s")
    for i, (resp_data, headers, time_taken) in enumerate(zip(response_obj.data, response_obj.response_headers, response_obj.individual_request_times)):
        print(f"Async Response {i+1}:")
        print(f"  Data: {resp_data}")
        print(f"  Headers: {headers}")
        print(f"  Time taken: {time_taken:.4f}s")

# To run:
# asyncio.run(async_batch_post_example())

Reranking

Reranking compatible with BEI or text-embeddings-inference.

Synchronous Reranking

from baseten_performance_client import RequestProcessingPreference

query = "What is the best framework?"
documents = ["Doc 1 text", "Doc 2 text", "Doc 3 text"]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
rerank_response = client.rerank(
    query=query,
    texts=documents,
    model="rerank-model",  # Optional model specification
    return_text=True,
    preference=preference
)
for res in rerank_response.data:
    print(f"Index: {res.index} Score: {res.score}")

Asynchronous Reranking

async def async_rerank():
    from baseten_performance_client import RequestProcessingPreference

    query = "Async query sample"
    docs = ["Async doc1", "Async doc2"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_rerank(
        query=query,
        texts=docs,
        model="rerank-model",  # Optional model specification
        return_text=True,
        preference=preference
    )
    for res in response.data:
        print(f"Async Index: {res.index} Score: {res.score}")

# To run:
# asyncio.run(async_rerank())

Classification

Predict (classification endpoint) compatible with BEI or text-embeddings-inference.

Synchronous Classification

from baseten_performance_client import RequestProcessingPreference

texts_to_classify = [
    "This is great!",
    "I did not like it.",
    "Neutral experience."
]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
classify_response = client.classify(
    inputs=texts_to_classify,
    model="classification-model",  # Optional model specification
    preference=preference
)
for group in classify_response.data:
    for result in group:
        print(f"Label: {result.label}, Score: {result.score}")

Asynchronous Classification

async def async_classify():
    from baseten_performance_client import RequestProcessingPreference

    texts = ["Async positive", "Async negative"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_classify(
        inputs=texts,
        model="classification-model",  # Optional model specification
        preference=preference
    )
    for group in response.data:
        for res in group:
            print(f"Async Label: {res.label}, Score: {res.score}")

# To run:
# asyncio.run(async_classify())

Advanced Features

RequestProcessingPreference

The RequestProcessingPreference class provides a unified way to configure all request processing parameters. This is the recommended approach for advanced configuration as it provides better type safety and clearer intent.

The framework defaults are 256 concurrent requests, a batch size of 8, and 8,000 characters per request. max_chars_per_request accepts values from 50 through 1,048,576.

from baseten_performance_client import RequestProcessingPreference

# Create a preference with custom settings
preference = RequestProcessingPreference(
    max_concurrent_requests=64,        # Parallel requests (default: 256)
    batch_size=32,                     # Items per batch (default: 8)
    timeout_s=30.0,                   # Per-request timeout (default: 3600.0)
    hedge_delay=0.5,                  # Hedging delay (default: None)
    hedge_budget_pct=0.15,            # Hedge budget percentage (default: 0.10)
    retry_budget_pct=0.08,            # Retry budget percentage (default: 0.05)
    max_retries=5,                    # Maximum HTTP retries (default: 5)
    initial_backoff_ms=250,           # Initial backoff in milliseconds (default: 125)
    total_timeout_s=300.0              # Total operation timeout (default: None)
)

# Use with any method
response = client.embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

# Also works with async methods
response = await client.async_embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

Property-based Configuration: You can also modify preferences after creation using property setters:

# Create preference and modify properties
preference = RequestProcessingPreference()
preference.max_concurrent_requests = 64        # Set parallel requests
preference.batch_size = 32                     # Set batch size
preference.timeout_s = 30.0                    # Set timeout
preference.hedge_delay = 0.5                   # Enable hedging
preference.hedge_budget_pct = 0.15            # Set hedge budget
preference.retry_budget_pct = 0.08            # Set retry budget
preference.max_retries = 3                     # Set max retries
preference.initial_backoff_ms = 250            # Set backoff

# Use with any method
response = client.embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

Budget Percentages:

  • hedge_budget_pct: Percentage of total requests allocated for hedging (default: 10%)
  • retry_budget_pct: Percentage of total requests allocated for retries (default: 5%)
  • Maximum allowed: 300% for both budgets

Retry Configuration:

  • HTTP status-code retries are controlled by max_retries, not by retry_budget_pct.
  • Retryable status codes by default: 408, 409, 429, and 500 through 599.
  • Use non_retryable_status_codes={529} to opt specific statuses out of the default retry policy.
  • max_retries: Maximum HTTP status-code retries per request (default: 5, max: 6). Set to 0 to disable these retries.
  • retry_budget_pct: Budget for timeout and network-error retry paths (default: 5%, max: 300%).
  • initial_backoff_ms: Initial backoff duration in milliseconds (default: 125, range: 50-45000).
  • Backoff multiplies by 4 after each retry, caps at 45000ms, and adds 0-99ms jitter. With defaults, the retry sleeps are about 125ms, 500ms, 2000ms, 8000ms, and 32000ms; a sixth retry sleeps about 45000ms.

Request Hedging

The client supports request hedging for improved latency by sending duplicate requests after a specified delay:

# Enable hedging with 0.5 second delay
preference = RequestProcessingPreference(
    hedge_delay=0.5,  # Send hedge request after 0.5s
    max_chars_per_request=256000,
    total_timeout_s=360
)
response = client.embed(
    input=texts,
    model="my_model",
    preference=preference
)

Custom Headers

Use custom headers with batch_post:

preference = RequestProcessingPreference(
    extra_headers={
        "x-custom-header": "value",
        "authorization": "Bearer token"
    }
)
response = client.batch_post(
    url_path="/v1/embeddings",
    payloads=payloads,
    preference=preference
)

HTTP Version Selection

Choose between HTTP/1.1 and HTTP/2:

# HTTP/1.1 (default, better for high concurrency)
client_http1 = PerformanceClient(base_url, api_key, http_version=1)

# HTTP/2 (better for single requests)
client_http2 = PerformanceClient(base_url, api_key, http_version=2)

Connection Pooling

Share connection pools across multiple clients:

from baseten_performance_client import HttpClientWrapper

# Create shared wrapper
wrapper = HttpClientWrapper(http_version=1)

# Reuse across multiple clients
client1 = PerformanceClient(base_url="https://api1.example.com", client_wrapper=wrapper)
client2 = PerformanceClient(base_url="https://api2.example.com", client_wrapper=wrapper)

HTTP Proxy Support

Route all HTTP requests through a proxy (e.g., for connection pooling with Envoy):

from baseten_performance_client import HttpClientWrapper

# Create wrapper with HTTP proxy
wrapper = HttpClientWrapper(
    http_version=1,
    proxy="http://envoy-proxy.local:8080"
)

# Share the wrapper across multiple clients
client1 = PerformanceClient(
    base_url="https://api1.example.com",
    api_key="your_key",
    client_wrapper=wrapper
)
client2 = PerformanceClient(
    base_url="https://api2.example.com",
    api_key="your_key",
    client_wrapper=wrapper
)
# Both clients will use the same connection pool and proxy

You can also specify the proxy directly when creating a client:

client = PerformanceClient(
    base_url="https://api.example.com",
    api_key="your_key",
    proxy="http://envoy-proxy.local:8080"
)

Endpoint Pool and Health Checks

Route traffic across reusable endpoints with deterministic weighted routing. Each Endpoint owns its own health worker, so the same endpoint object can be shared across many pools without duplicate probes:

from baseten_performance_client import Endpoint, EndpointPool, HttpClientWrapper, PerformanceClient

health_wrapper = HttpClientWrapper(http_version=1)
endpoint_a = Endpoint(
    base_url="https://model-AAAA.api.baseten.co/environments/production/sync",
    api_key="your_key",
    client_wrapper=health_wrapper,
    deployment_health_path="/health",
    deployment_timeout_is_no_vote=False,
)
endpoint_b = Endpoint(
    base_url="https://model-BBBB.api.baseten.co/environments/production/sync",
    api_key="your_key",
    client_wrapper=health_wrapper,
    deployment_health_path="/health",
    deployment_timeout_is_no_vote=False,
)

endpoint_pool = EndpointPool(
    endpoints=[endpoint_a, endpoint_b],
    endpoint_weights=[0.8, 0.2],  # deterministic weighted routing
)

client = PerformanceClient(
    base_url="https://model-AAAA.api.baseten.co/environments/production/sync",
    api_key="your_key",
    endpoint_pool=endpoint_pool,
)

Health semantics:

  • Weights are deterministic weighted routing, not weighted round robin.
  • Each configured health check is retried up to health_check_retries, and one successful retry is enough for that check.
  • If an endpoint has deep_health_url configured, both the shallow deployment health path and the deep health URL are evaluated.
  • health_fail_on_first=True short-circuits on the first hard failing check within an endpoint refresh cycle.

Error Handling

The client can raise several types of errors. Here's how to handle common ones:

  • requests.exceptions.HTTPError: This error is raised for HTTP issues, such as authentication failures (e.g., 401 Unauthorized if the API key is wrong), server errors (e.g., 5xx), or if the endpoint is not found (404). You can inspect e.response.status_code and e.response.text (or e.response.json() if the body is JSON) for more details.
  • ValueError: This error can occur due to invalid input parameters (e.g., an empty input list for embed, invalid batch_size or max_concurrent_requests values). It can also be raised by response.numpy() if embeddings are not float vectors or have inconsistent dimensions.

Here's an example demonstrating how to catch these errors for the embed method:

import requests
from baseten_performance_client import RequestProcessingPreference

# client = PerformanceClient(base_url="your_baseten_url", api_key="your_baseten_api_key")

texts_to_embed = ["Hello world", "Another text example"]
try:
    preference = RequestProcessingPreference(
        batch_size=2,
        max_concurrent_requests=4,
        timeout_s=60 # Timeout in seconds
    )
    response = client.embed(
        input=texts_to_embed,
        model="your_embedding_model", # Replace with your actual model name
        preference=preference
    )
    # Process successful response
    print(f"Model used: {response.model}")
    print(f"Total tokens: {response.usage.total_tokens}")
    for item in response.data:
        embedding_preview = item.embedding[:3] if isinstance(item.embedding, list) else "Base64 Data"
        print(f"Index {item.index}, Embedding (first 3 dims or type): {embedding_preview}")

except requests.exceptions.HTTPError as e:
    print(f"An HTTP error occurred: {e}, code {e.args[0]}")

For asynchronous methods (async_embed, async_rerank, async_classify, async_batch_post), the same exceptions will be raised by the await call and can be caught using a try...except block within an async def function.

Development

# Install prerequisites
sudo apt-get install patchelf
# Install cargo if not already installed.

# Set up a Python virtual environment
python -m venv .venv
source .venv/bin/activate

# Install development dependencies
pip install maturin[patchelf] pytest requests numpy

# Build and install the Rust extension in development mode
maturin develop
cargo fmt
# Run tests
pytest tests

Contributions

Feel free to contribute to this repo, tag @michaelfeil for review.

License

MIT License

System One decisions

Send independent requests to /v1/systemone; use a one-element list for one request.

requests = [{
    "state": "My invoice was charged twice.",
    "questions": {"route": {
        "type": "choice",
        "instructions": "Which team should handle this?",
        "criteria": {"billing": None, "support": None},
    }},
}]
response = client.batch_system_one(requests=requests)
print(response.data[0]["answers"]["route"])
# Async: await client.async_batch_system_one(requests=requests)

Add model or backend-specific fields to each request as needed. .data preserves input order; the response also includes timings and headers. Existing request preferences apply. Supported question types depend on the backend.

Metadata

Release files for baseten-performance-client 0.1.19

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for baseten-performance-client 0.1.19
File Size Uploaded Provenance Actions
baseten_performance_client-0.1.19.tar.gz 127.5 kB Without provenance Details for baseten_performance_client-0.1.19.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for baseten-performance-client 0.1.19
File Actions
baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_x86_64.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-64 Details for baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_x86_64.whl
baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_i686.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-32 Details for baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_i686.whl
baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_armv7l.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARMv7l Details for baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_armv7l.whl
baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_aarch64.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARM64 Details for baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_aarch64.whl
baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-64 Details for baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ PowerPC 64-le Details for baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-32 Details for baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl
baseten_performance_client-0.1.19-cp313-cp313t-macosx_11_0_arm64.whl CPython 3.13 CPython 3.13 free-threading macOS 11.0+ ARM64 Details for baseten_performance_client-0.1.19-cp313-cp313t-macosx_11_0_arm64.whl
baseten_performance_client-0.1.19-cp313-cp313t-macosx_10_12_x86_64.whl CPython 3.13 CPython 3.13 free-threading macOS 10.12+ x86-64 Details for baseten_performance_client-0.1.19-cp313-cp313t-macosx_10_12_x86_64.whl
baseten_performance_client-0.1.19-cp38-abi3-win_amd64.whl CPython 3.8 abi3 Windows x86-64 Details for baseten_performance_client-0.1.19-cp38-abi3-win_amd64.whl
baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_x86_64.whl CPython 3.8 abi3 Linux musl 1.2+ x86-64 Details for baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_x86_64.whl
baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_i686.whl CPython 3.8 abi3 Linux musl 1.2+ x86-32 Details for baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_i686.whl
baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_armv7l.whl CPython 3.8 abi3 Linux musl 1.2+ ARMv7l Details for baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_armv7l.whl
baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_aarch64.whl CPython 3.8 abi3 Linux musl 1.2+ ARM64 Details for baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_aarch64.whl
baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_armv7l.whl CPython 3.8 abi3 Linux glibc 2.28+ ARMv7l Details for baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_armv7l.whl
baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_aarch64.whl CPython 3.8 abi3 Linux glibc 2.28+ ARM64 Details for baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_aarch64.whl
baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl CPython 3.8 abi3 Linux glibc 2.17+ x86-64 Details for baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl CPython 3.8 abi3 Linux glibc 2.17+ PowerPC 64-le Details for baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl
baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl CPython 3.8 abi3 Linux glibc 2.17+ x86-32 Details for baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl
baseten_performance_client-0.1.19-cp38-abi3-macosx_11_0_arm64.whl CPython 3.8 abi3 macOS 11.0+ ARM64 Details for baseten_performance_client-0.1.19-cp38-abi3-macosx_11_0_arm64.whl
baseten_performance_client-0.1.19-cp38-abi3-macosx_10_12_x86_64.whl CPython 3.8 abi3 macOS 10.12+ x86-64 Details for baseten_performance_client-0.1.19-cp38-abi3-macosx_10_12_x86_64.whl

Total release size: 119.7 MB

Release files / baseten_performance_client-0.1.19.tar.gz

Download URL baseten_performance_client-0.1.19.tar.gz
Size 127.5 kB
Tags Source
SHA-256 checksum
How to use checksums
06affac78857db309ae555fbce90855e726ff6fa17b66bc87a7a185d94a564a8
BLAKE2b-256 checksum
How to use checksums
65b628a171f0c3ca883553c6116bc71fc8305392a8b52985a1143cc0207be8e0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_x86_64.whl
Size 6.4 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-64
SHA-256 checksum
How to use checksums
ee35f08e41809bf77a0ca97ce6a825998babcfb2e114c41a2a34b4c6c5c01c36
BLAKE2b-256 checksum
How to use checksums
beb434a8290d27bac11a8490887d0e273434cacba9f40af3d4ab869670dadb18
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_i686.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_i686.whl
Size 6.2 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-32
SHA-256 checksum
How to use checksums
30bcfd9703158bc508c3348fd558cc5928370c1dbe12d393c358f9165d946703
BLAKE2b-256 checksum
How to use checksums
083cd5bc2a4f9fac63e75e7371c49a69b8ab0fece904a02e60aafe5d24207846
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_armv7l.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_armv7l.whl
Size 5.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARMv7l
SHA-256 checksum
How to use checksums
07ce5b21df6edf1f96865bad30584c59c459f5441e5511d5ec110c80f28194e6
BLAKE2b-256 checksum
How to use checksums
672f19ce809af0843280ec655a59b62e21752e2205a538f924479c9bfe9fb466
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_aarch64.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-musllinux_1_2_aarch64.whl
Size 6.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARM64
SHA-256 checksum
How to use checksums
61ffd68b70b71b4124d8e7a2f3b067d4f646b377967f710dc9caaca2c39c294c
BLAKE2b-256 checksum
How to use checksums
43f178b55c49f7dffd50f3f36f0fa92d5eab8c648d9011b4d3cd97d1a5ce1a67
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.0 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
c4c82c024aedc76a97926fc21440fdc71a0484a2f73b27d4a0896f3f3438377d
BLAKE2b-256 checksum
How to use checksums
250b2d95b85e59cdeb5d32907623532a34958fb928deace52eb0424055b900db
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 6.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums
65dafe565a0d9b775fcedeacaf87a7bcd570e6ab1c3c0b4ac9e50c036e3aa255
BLAKE2b-256 checksum
How to use checksums
1ed5050083f99df4679ca69e3e322fef2ca7f38a9879c42bcaafe87b97515128
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl
Size 6.2 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums
0ecb27baeb5b6059990ed6e6f102b28d10deaf3fffdcc91012a657a1568e7fdd
BLAKE2b-256 checksum
How to use checksums
24949efe76e82f116184b47d10918e6d70e6bd6cc96087bd97047e304a17b300
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-macosx_11_0_arm64.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-macosx_11_0_arm64.whl
Size 3.5 MB
Tags CPython 3.13 CPython 3.13 free-threading macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
b6cbd482098cddd871fc9a80373f3b3a09d37c066c841b13df1efd98dfc55cc6
BLAKE2b-256 checksum
How to use checksums
cf39514c3f787adc4cca02531132a615ef067013abf8dd78b20daf612dbbc935
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp313-cp313t-macosx_10_12_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp313-cp313t-macosx_10_12_x86_64.whl
Size 3.7 MB
Tags CPython 3.13 CPython 3.13 free-threading macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
1695f7f527ad41912a532263af276be323d1c079d6c8c5641839a56a37816e6e
BLAKE2b-256 checksum
How to use checksums
90ea1157d27a358dbf39776edd046f63cc49f3c8164967d20f92d1e07d42cc04
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-win_amd64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-win_amd64.whl
Size 3.5 MB
Tags CPython 3.8 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
ae1c97684aa8f9be4d736769bf21125a67302bbf5e4a28fa0b8b2a59390a1dcf
BLAKE2b-256 checksum
How to use checksums
768960ff529ad03060385af41f06f5937a5bc4987ce1daef1f0e4bfffce3f9c0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_x86_64.whl
Size 6.6 MB
Tags CPython 3.8 Linux musl 1.2+ x86-64 abi3
SHA-256 checksum
How to use checksums
3a5cb5afd290acea183bf895c346ed593791988e891d6cabb074113e8e10d8a8
BLAKE2b-256 checksum
How to use checksums
bcb84578f243846a2704379f29527d5a28fa710495485958251010e4439db59d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_i686.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_i686.whl
Size 6.4 MB
Tags CPython 3.8 Linux musl 1.2+ x86-32 abi3
SHA-256 checksum
How to use checksums
f8ce1fb185a97a294bd3077e3bed5ce96629ddb36c3d114277fd4900c52d03bc
BLAKE2b-256 checksum
How to use checksums
972b5b1d835dc302c19a3fe410a7b5a810e49015ee0965f52a5a838a5f07c689
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_armv7l.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_armv7l.whl
Size 5.9 MB
Tags CPython 3.8 Linux musl 1.2+ ARMv7l abi3
SHA-256 checksum
How to use checksums
8540d228365b8600f50d36d0e2a6eba68358c7c99b6e5b2cc5d82a9deea9c8e9
BLAKE2b-256 checksum
How to use checksums
aae484709031ecc68e0398a8961ba84658ad2f8bec91860dcba2d793c0842c8f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_aarch64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-musllinux_1_2_aarch64.whl
Size 6.9 MB
Tags CPython 3.8 Linux musl 1.2+ ARM64 abi3
SHA-256 checksum
How to use checksums
e8f20c367419792760ec1fbf7ff08c18817d1c311192ad4ad964f16e43d50d42
BLAKE2b-256 checksum
How to use checksums
9c683bb40943548d161691e0d034ef1e22694cc99064cffe0a40de2f2bab538c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_armv7l.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_armv7l.whl
Size 5.6 MB
Tags CPython 3.8 Linux glibc 2.28+ ARMv7l abi3
SHA-256 checksum
How to use checksums
2b14c6f12dbf2023c8cf06cd4c0c24d91201f7c058617d24ec59615aca72439a
BLAKE2b-256 checksum
How to use checksums
dc538b49ebbee54c8e6a2f734452a2c157f50d93c03fa97c36f0ffe5fbb34543
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_aarch64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-manylinux_2_28_aarch64.whl
Size 6.5 MB
Tags CPython 3.8 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
6a70c1561ef40dadfeba0e22f1eb8623d5205483a4afdbf912d80c54044126fc
BLAKE2b-256 checksum
How to use checksums
6de57035a8790f831250d3f978d654a4faa6b5230c5803bed92de76dcdd78ecd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Size 6.2 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
3ef36037f1baeae77d2bc4dd01d17bf41b285ce5a5b1bd0d1544fad38b1009b2
BLAKE2b-256 checksum
How to use checksums
6394c728717c9e346d756a02c64c49cf4df112981999a34a1a1e0d96ebdc4b40
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl
Size 6.9 MB
Tags CPython 3.8 Linux glibc 2.17+ PowerPC 64-le abi3
SHA-256 checksum
How to use checksums
5b16d5af5f0b8e21682678a1dfa7b4adb7581f2c74b7782a2aa2e1aeafa04258
BLAKE2b-256 checksum
How to use checksums
704b323037fd7e1b20deec9177019f19fd09d137797a23c262f7ccd9a2a89ee3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl
Size 6.4 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-32 abi3
SHA-256 checksum
How to use checksums
6e9e4e4fc5c26a0feb179c784207b762a5d9d42c8235d8c680a58e09b87c6298
BLAKE2b-256 checksum
How to use checksums
85b116843804d6e833e11010e175db14c362b29e4e9fa091bf9db180af241fa5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-macosx_11_0_arm64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-macosx_11_0_arm64.whl
Size 3.7 MB
Tags CPython 3.8 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
32f4a7fc14e1ea7bac9ede0a43d6c506d368cab61c2fc693b5beb8b5a5689b2c
BLAKE2b-256 checksum
How to use checksums
6b0d23829689b1f616e45af4acf3eb6a19b42f72a12ea0bdc0ec57c25d2ed2cc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.19-cp38-abi3-macosx_10_12_x86_64.whl

Download URL baseten_performance_client-0.1.19-cp38-abi3-macosx_10_12_x86_64.whl
Size 3.8 MB
Tags CPython 3.8 abi3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
3b37e01caf1363f7fc1c6976a7544bdce93e084e0020800f1eb16b3733bd3a52
BLAKE2b-256 checksum
How to use checksums
c28036ca7ab5e10b83b76c38264f07b65bde50714f77645a858caf5e834b7ae9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Security for baseten-performance-client 0.1.19

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.19 This release

22 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page