Skip to main content

High performance client for Baseten.co

This library provides a high-performance Python client for Baseten.co endpoints including embeddings, reranking, and classification. It was built for massive concurrent post requests to any URL, also outside of baseten.co. PerformanceClient releases the GIL while performing requests in the Rust, and supports simultaneous sync and async usage. It was benchmarked with >1200 rps per client in our blog. PerformanceClient is built on top of pyo3, reqwest and tokio and is MIT licensed.

benchmarks

Installation

pip install baseten_performance_client

Usage

import os
import asyncio
from baseten_performance_client import PerformanceClient, OpenAIEmbeddingsResponse, RerankResponse, ClassificationResponse

api_key = os.environ.get("BASETEN_API_KEY")
base_url_embed = "https://model-yqv4yjjq.api.baseten.co/environments/production/sync"
# Also works with OpenAI or Mixedbread.
# base_url_embed = "https://api.openai.com" or "https://api.mixedbread.com"

# Basic client setup
client = PerformanceClient(base_url=base_url_embed, api_key=api_key)

# Advanced setup with HTTP version selection and connection pooling
from baseten_performance_client import HttpClientWrapper
http_wrapper = HttpClientWrapper(http_version=1)  # HTTP/1.1 (default)
advanced_client = PerformanceClient(
    base_url=base_url_embed,
    api_key=api_key,
    http_version=1,  # HTTP/1.1
    client_wrapper=http_wrapper  # Share connection pool
)

Embeddings

Synchronous Embedding

from baseten_performance_client import RequestProcessingPreference

texts = ["Hello world", "Example text", "Another sample"]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
response = client.embed(
    input=texts,
    model="my_model",
    preference=preference
)

# Accessing embedding data
print(f"Model used: {response.model}")
print(f"Total tokens used: {response.usage.total_tokens}")
print(f"Total time: {response.total_time:.4f}s")
if response.individual_batch_request_times:
    for i, batch_time in enumerate(response.individual_batch_request_times):
        print(f"  Time for batch {i}: {batch_time:.4f}s")

for i, embedding_data in enumerate(response.data):
    print(f"Embedding for text {i} (original input index {embedding_data.index}):")
    # embedding_data.embedding can be List[float] or str (base64)
    if isinstance(embedding_data.embedding, list):
        print(f"  First 3 dimensions: {embedding_data.embedding[:3]}")
        print(f"  Length: {len(embedding_data.embedding)}")

# Using the numpy() method (requires numpy to be installed)
import numpy as np
numpy_array = response.numpy()
print("\nEmbeddings as NumPy array:")
print(f"  Shape: {numpy_array.shape}")
print(f"  Data type: {numpy_array.dtype}")
if numpy_array.shape[0] > 0:
    print(f"  First 3 dimensions of the first embedding: {numpy_array[0][:3]}")

Note: The embed method is versatile and can be used with any embeddings service, e.g. OpenAI API embeddings, not just for Baseten deployments.

Asynchronous Embedding

async def async_embed():
    from baseten_performance_client import RequestProcessingPreference

    texts = ["Async hello", "Async example"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_embed(
        input=texts,
        model="my_model",
        preference=preference
    )
    print("Async embedding response:", response.data)

# To run:
# asyncio.run(async_embed())

Embedding Benchmarks

Comparison against pip install openai for /v1/embeddings. Tested with the ./scripts/compare_latency_openai.py with mini_batch_size of 128, and 4 server-side replicas. Results with OpenAI similar, OpenAI allows a max mini_batch_size of 2048.

Number of inputs / embeddings Number of Tasks PerformanceClient (s) AsyncOpenAI (s) Speedup
128 1 0.12 0.13 1.08×
512 4 0.14 0.21 1.50×
8 192 64 0.83 1.95 2.35×
131 072 1 024 4.63 39.07 8.44×
2 097 152 16 384 70.92 903.68 12.74×

General Batch POST

The batch_post method is generic. It can be used to send POST requests to any URL, not limited to Baseten endpoints. The input and output can be any JSON item.

Synchronous Batch POST

from baseten_performance_client import RequestProcessingPreference

payload1 = {"model": "my_model", "input": ["Batch request sample 1"]}
payload2 = {"model": "my_model", "input": ["Batch request sample 2"]}
preference = RequestProcessingPreference(
    max_concurrent_requests=32,
    timeout_s=360,
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360,  # Total operation timeout
    extra_headers={"x-custom-header": "value"}  # Custom headers
)
response_obj = client.batch_post(
    url_path="/v1/embeddings", # Example path, adjust to your needs
    payloads=[payload1, payload2],
    preference=preference
)
print(f"Total time for batch POST: {response_obj.total_time:.4f}s")
for i, (resp_data, headers, time_taken) in enumerate(zip(response_obj.data, response_obj.response_headers, response_obj.individual_request_times)):
    print(f"Response {i+1}:")
    print(f"  Data: {resp_data}")
    print(f"  Headers: {headers}")
    print(f"  Time taken: {time_taken:.4f}s")

Asynchronous Batch POST

async def async_batch_post_example():
    from baseten_performance_client import RequestProcessingPreference

    payload1 = {"model": "my_model", "input": ["Async batch sample 1"]}
    payload2 = {"model": "my_model", "input": ["Async batch sample 2"]}
preference = RequestProcessingPreference(
    max_concurrent_requests=32,
    timeout_s=360,
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360,  # Total operation timeout
    extra_headers={"x-custom-header": "value"}  # Custom headers
)
    response_obj = await client.async_batch_post(
        url_path="/v1/embeddings",
        payloads=[payload1, payload2],
        preference=preference
    )
    print(f"Async total time for batch POST: {response_obj.total_time:.4f}s")
    for i, (resp_data, headers, time_taken) in enumerate(zip(response_obj.data, response_obj.response_headers, response_obj.individual_request_times)):
        print(f"Async Response {i+1}:")
        print(f"  Data: {resp_data}")
        print(f"  Headers: {headers}")
        print(f"  Time taken: {time_taken:.4f}s")

# To run:
# asyncio.run(async_batch_post_example())

Reranking

Reranking compatible with BEI or text-embeddings-inference.

Synchronous Reranking

from baseten_performance_client import RequestProcessingPreference

query = "What is the best framework?"
documents = ["Doc 1 text", "Doc 2 text", "Doc 3 text"]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
rerank_response = client.rerank(
    query=query,
    texts=documents,
    model="rerank-model",  # Optional model specification
    return_text=True,
    preference=preference
)
for res in rerank_response.data:
    print(f"Index: {res.index} Score: {res.score}")

Asynchronous Reranking

async def async_rerank():
    from baseten_performance_client import RequestProcessingPreference

    query = "Async query sample"
    docs = ["Async doc1", "Async doc2"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_rerank(
        query=query,
        texts=docs,
        model="rerank-model",  # Optional model specification
        return_text=True,
        preference=preference
    )
    for res in response.data:
        print(f"Async Index: {res.index} Score: {res.score}")

# To run:
# asyncio.run(async_rerank())

Classification

Predict (classification endpoint) compatible with BEI or text-embeddings-inference.

Synchronous Classification

from baseten_performance_client import RequestProcessingPreference

texts_to_classify = [
    "This is great!",
    "I did not like it.",
    "Neutral experience."
]
preference = RequestProcessingPreference(
    batch_size=16,
    max_concurrent_requests=32,
    timeout_s=360,
    max_chars_per_request=256000,  # Character limit per request
    hedge_delay=0.5,  # Enable hedging with 0.5s delay
    total_timeout_s=360  # Total operation timeout
)
classify_response = client.classify(
    inputs=texts_to_classify,
    model="classification-model",  # Optional model specification
    preference=preference
)
for group in classify_response.data:
    for result in group:
        print(f"Label: {result.label}, Score: {result.score}")

Asynchronous Classification

async def async_classify():
    from baseten_performance_client import RequestProcessingPreference

    texts = ["Async positive", "Async negative"]
    preference = RequestProcessingPreference(
        batch_size=16,
        max_concurrent_requests=32,
        timeout_s=360,
        max_chars_per_request=256000,  # Character limit per request
        hedge_delay=0.5,  # Enable hedging with 0.5s delay
        total_timeout_s=360  # Total operation timeout
    )
    response = await client.async_classify(
        inputs=texts,
        model="classification-model",  # Optional model specification
        preference=preference
    )
    for group in response.data:
        for res in group:
            print(f"Async Label: {res.label}, Score: {res.score}")

# To run:
# asyncio.run(async_classify())

Advanced Features

RequestProcessingPreference

The RequestProcessingPreference class provides a unified way to configure all request processing parameters. This is the recommended approach for advanced configuration as it provides better type safety and clearer intent.

The framework defaults are 256 concurrent requests, a batch size of 8, and 8,000 characters per request. max_chars_per_request accepts values from 50 through 1,048,576.

from baseten_performance_client import RequestProcessingPreference

# Create a preference with custom settings
preference = RequestProcessingPreference(
    max_concurrent_requests=64,        # Parallel requests (default: 256)
    batch_size=32,                     # Items per batch (default: 8)
    timeout_s=30.0,                   # Per-request timeout (default: 3600.0)
    hedge_delay=0.5,                  # Hedging delay (default: None)
    hedge_budget_pct=0.15,            # Hedge budget percentage (default: 0.10)
    retry_budget_pct=0.08,            # Retry budget percentage (default: 0.05)
    max_retries=5,                    # Maximum HTTP retries (default: 5)
    initial_backoff_ms=250,           # Initial backoff in milliseconds (default: 125)
    total_timeout_s=300.0              # Total operation timeout (default: None)
)

# Use with any method
response = client.embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

# Also works with async methods
response = await client.async_embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

Property-based Configuration: You can also modify preferences after creation using property setters:

# Create preference and modify properties
preference = RequestProcessingPreference()
preference.max_concurrent_requests = 64        # Set parallel requests
preference.batch_size = 32                     # Set batch size
preference.timeout_s = 30.0                    # Set timeout
preference.hedge_delay = 0.5                   # Enable hedging
preference.hedge_budget_pct = 0.15            # Set hedge budget
preference.retry_budget_pct = 0.08            # Set retry budget
preference.max_retries = 3                     # Set max retries
preference.initial_backoff_ms = 250            # Set backoff

# Use with any method
response = client.embed(
    input=["text1", "text2"],
    model="my_model",
    preference=preference
)

Budget Percentages:

  • hedge_budget_pct: Percentage of total requests allocated for hedging (default: 10%)
  • retry_budget_pct: Percentage of total requests allocated for retries (default: 5%)
  • Maximum allowed: 300% for both budgets

Retry Configuration:

  • HTTP status-code retries are controlled by max_retries, not by retry_budget_pct.
  • Retryable status codes by default: 408, 409, 429, and 500 through 599.
  • Use non_retryable_status_codes={529} to opt specific statuses out of the default retry policy.
  • max_retries: Maximum HTTP status-code retries per request (default: 5, max: 6). Set to 0 to disable these retries.
  • retry_budget_pct: Budget for timeout and network-error retry paths (default: 5%, max: 300%).
  • initial_backoff_ms: Initial backoff duration in milliseconds (default: 125, range: 50-45000).
  • Backoff multiplies by 4 after each retry, caps at 45000ms, and adds 0-99ms jitter. With defaults, the retry sleeps are about 125ms, 500ms, 2000ms, 8000ms, and 32000ms; a sixth retry sleeps about 45000ms.

Request Hedging

The client supports request hedging for improved latency by sending duplicate requests after a specified delay:

# Enable hedging with 0.5 second delay
preference = RequestProcessingPreference(
    hedge_delay=0.5,  # Send hedge request after 0.5s
    max_chars_per_request=256000,
    total_timeout_s=360
)
response = client.embed(
    input=texts,
    model="my_model",
    preference=preference
)

Custom Headers

Use custom headers with batch_post:

preference = RequestProcessingPreference(
    extra_headers={
        "x-custom-header": "value",
        "authorization": "Bearer token"
    }
)
response = client.batch_post(
    url_path="/v1/embeddings",
    payloads=payloads,
    preference=preference
)

HTTP Version Selection

Choose between HTTP/1.1 and HTTP/2:

# HTTP/1.1 (default, better for high concurrency)
client_http1 = PerformanceClient(base_url, api_key, http_version=1)

# HTTP/2 (better for single requests)
client_http2 = PerformanceClient(base_url, api_key, http_version=2)

Connection Pooling

Share connection pools across multiple clients:

from baseten_performance_client import HttpClientWrapper

# Create shared wrapper
wrapper = HttpClientWrapper(http_version=1)

# Reuse across multiple clients
client1 = PerformanceClient(base_url="https://api1.example.com", client_wrapper=wrapper)
client2 = PerformanceClient(base_url="https://api2.example.com", client_wrapper=wrapper)

HTTP Proxy Support

Route all HTTP requests through a proxy (e.g., for connection pooling with Envoy):

from baseten_performance_client import HttpClientWrapper

# Create wrapper with HTTP proxy
wrapper = HttpClientWrapper(
    http_version=1,
    proxy="http://envoy-proxy.local:8080"
)

# Share the wrapper across multiple clients
client1 = PerformanceClient(
    base_url="https://api1.example.com",
    api_key="your_key",
    client_wrapper=wrapper
)
client2 = PerformanceClient(
    base_url="https://api2.example.com",
    api_key="your_key",
    client_wrapper=wrapper
)
# Both clients will use the same connection pool and proxy

You can also specify the proxy directly when creating a client:

client = PerformanceClient(
    base_url="https://api.example.com",
    api_key="your_key",
    proxy="http://envoy-proxy.local:8080"
)

Endpoint Pool and Health Checks

Route traffic across reusable endpoints with deterministic weighted routing. Each Endpoint owns its own health worker, so the same endpoint object can be shared across many pools without duplicate probes:

from baseten_performance_client import Endpoint, EndpointPool, HttpClientWrapper, PerformanceClient

health_wrapper = HttpClientWrapper(http_version=1)
endpoint_a = Endpoint(
    base_url="https://model-AAAA.api.baseten.co/environments/production/sync",
    api_key="your_key",
    client_wrapper=health_wrapper,
    deployment_health_path="/health",
    deployment_timeout_is_no_vote=False,
)
endpoint_b = Endpoint(
    base_url="https://model-BBBB.api.baseten.co/environments/production/sync",
    api_key="your_key",
    client_wrapper=health_wrapper,
    deployment_health_path="/health",
    deployment_timeout_is_no_vote=False,
)

endpoint_pool = EndpointPool(
    endpoints=[endpoint_a, endpoint_b],
    endpoint_weights=[0.8, 0.2],  # deterministic weighted routing
)

client = PerformanceClient(
    base_url="https://model-AAAA.api.baseten.co/environments/production/sync",
    api_key="your_key",
    endpoint_pool=endpoint_pool,
)

Health semantics:

  • Weights are deterministic weighted routing, not weighted round robin.
  • Each configured health check is retried up to health_check_retries, and one successful retry is enough for that check.
  • If an endpoint has deep_health_url configured, both the shallow deployment health path and the deep health URL are evaluated.
  • health_fail_on_first=True short-circuits on the first hard failing check within an endpoint refresh cycle.

Error Handling

The client can raise several types of errors. Here's how to handle common ones:

  • requests.exceptions.HTTPError: This error is raised for HTTP issues, such as authentication failures (e.g., 401 Unauthorized if the API key is wrong), server errors (e.g., 5xx), or if the endpoint is not found (404). You can inspect e.response.status_code and e.response.text (or e.response.json() if the body is JSON) for more details.
  • ValueError: This error can occur due to invalid input parameters (e.g., an empty input list for embed, invalid batch_size or max_concurrent_requests values). It can also be raised by response.numpy() if embeddings are not float vectors or have inconsistent dimensions.

Here's an example demonstrating how to catch these errors for the embed method:

import requests
from baseten_performance_client import RequestProcessingPreference

# client = PerformanceClient(base_url="your_baseten_url", api_key="your_baseten_api_key")

texts_to_embed = ["Hello world", "Another text example"]
try:
    preference = RequestProcessingPreference(
        batch_size=2,
        max_concurrent_requests=4,
        timeout_s=60 # Timeout in seconds
    )
    response = client.embed(
        input=texts_to_embed,
        model="your_embedding_model", # Replace with your actual model name
        preference=preference
    )
    # Process successful response
    print(f"Model used: {response.model}")
    print(f"Total tokens: {response.usage.total_tokens}")
    for item in response.data:
        embedding_preview = item.embedding[:3] if isinstance(item.embedding, list) else "Base64 Data"
        print(f"Index {item.index}, Embedding (first 3 dims or type): {embedding_preview}")

except requests.exceptions.HTTPError as e:
    print(f"An HTTP error occurred: {e}, code {e.args[0]}")

For asynchronous methods (async_embed, async_rerank, async_classify, async_batch_post), the same exceptions will be raised by the await call and can be caught using a try...except block within an async def function.

Development

# Install prerequisites
sudo apt-get install patchelf
# Install cargo if not already installed.

# Set up a Python virtual environment
python -m venv .venv
source .venv/bin/activate

# Install development dependencies
pip install maturin[patchelf] pytest requests numpy

# Build and install the Rust extension in development mode
maturin develop
cargo fmt
# Run tests
pytest tests

Contributions

Feel free to contribute to this repo, tag @michaelfeil for review.

License

MIT License

System One decisions

Send independent requests to /v1/systemone; use a one-element list for one request.

requests = [{
    "state": "My invoice was charged twice.",
    "questions": {"route": {
        "type": "choice",
        "instructions": "Which team should handle this?",
        "criteria": {"billing": None, "support": None},
    }},
}]
response = client.batch_system_one(requests=requests)
print(response.data[0]["answers"]["route"])
# Async: await client.async_batch_system_one(requests=requests)

Add model or backend-specific fields to each request as needed. .data preserves input order; the response also includes timings and headers. Existing request preferences apply. Supported question types depend on the backend.

Metadata

Release files for baseten-performance-client 0.1.18

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for baseten-performance-client 0.1.18
File Size Uploaded Provenance Actions
baseten_performance_client-0.1.18.tar.gz 124.5 kB Without provenance Details for baseten_performance_client-0.1.18.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for baseten-performance-client 0.1.18
File Actions
baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_x86_64.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-64 Details for baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_x86_64.whl
baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_i686.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-32 Details for baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_i686.whl
baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_armv7l.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARMv7l Details for baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_armv7l.whl
baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_aarch64.whl CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARM64 Details for baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_aarch64.whl
baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-64 Details for baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ PowerPC 64-le Details for baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-32 Details for baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl
baseten_performance_client-0.1.18-cp313-cp313t-macosx_11_0_arm64.whl CPython 3.13 CPython 3.13 free-threading macOS 11.0+ ARM64 Details for baseten_performance_client-0.1.18-cp313-cp313t-macosx_11_0_arm64.whl
baseten_performance_client-0.1.18-cp313-cp313t-macosx_10_12_x86_64.whl CPython 3.13 CPython 3.13 free-threading macOS 10.12+ x86-64 Details for baseten_performance_client-0.1.18-cp313-cp313t-macosx_10_12_x86_64.whl
baseten_performance_client-0.1.18-cp38-abi3-win_amd64.whl CPython 3.8 abi3 Windows x86-64 Details for baseten_performance_client-0.1.18-cp38-abi3-win_amd64.whl
baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_x86_64.whl CPython 3.8 abi3 Linux musl 1.2+ x86-64 Details for baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_x86_64.whl
baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_i686.whl CPython 3.8 abi3 Linux musl 1.2+ x86-32 Details for baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_i686.whl
baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_armv7l.whl CPython 3.8 abi3 Linux musl 1.2+ ARMv7l Details for baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_armv7l.whl
baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_aarch64.whl CPython 3.8 abi3 Linux musl 1.2+ ARM64 Details for baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_aarch64.whl
baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_armv7l.whl CPython 3.8 abi3 Linux glibc 2.28+ ARMv7l Details for baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_armv7l.whl
baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_aarch64.whl CPython 3.8 abi3 Linux glibc 2.28+ ARM64 Details for baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_aarch64.whl
baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl CPython 3.8 abi3 Linux glibc 2.17+ x86-64 Details for baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl CPython 3.8 abi3 Linux glibc 2.17+ PowerPC 64-le Details for baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl
baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl CPython 3.8 abi3 Linux glibc 2.17+ x86-32 Details for baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl
baseten_performance_client-0.1.18-cp38-abi3-macosx_11_0_arm64.whl CPython 3.8 abi3 macOS 11.0+ ARM64 Details for baseten_performance_client-0.1.18-cp38-abi3-macosx_11_0_arm64.whl
baseten_performance_client-0.1.18-cp38-abi3-macosx_10_12_x86_64.whl CPython 3.8 abi3 macOS 10.12+ x86-64 Details for baseten_performance_client-0.1.18-cp38-abi3-macosx_10_12_x86_64.whl

Total release size: 119.6 MB

Release files / baseten_performance_client-0.1.18.tar.gz

Download URL baseten_performance_client-0.1.18.tar.gz
Size 124.5 kB
Tags Source
SHA-256 checksum
How to use checksums
24a9cb9413101fd932bcddb50671b8b982d7d84f4d0cc83d6d263cb6e2c3142e
BLAKE2b-256 checksum
How to use checksums
af788dcf0645e228b9fe4c91cd8ab736d1cafe578e036924ce30e753a5dd47bf
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_x86_64.whl
Size 6.4 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-64
SHA-256 checksum
How to use checksums
24642fb012ab3487f89af43a92eb19570b4e88c6ca05748ec6ad8fbde1a712e4
BLAKE2b-256 checksum
How to use checksums
7eb4facbbdc5e4392d45375c525f1239d5ed17d77a29271a515d49b25c2d78ff
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_i686.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_i686.whl
Size 6.2 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ x86-32
SHA-256 checksum
How to use checksums
314319bb373d3395af071348bbaeab0fa11799986975a25922cf8389e05b9792
BLAKE2b-256 checksum
How to use checksums
91c5046b3da405914a3c6be41988f555486c3a98bc13b4619b821b859562d512
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_armv7l.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_armv7l.whl
Size 5.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARMv7l
SHA-256 checksum
How to use checksums
a5344b9fb74c3b0cf53ae3c919cf5bb45ed411bfa53585aa7f3853f61b1040da
BLAKE2b-256 checksum
How to use checksums
9376bcb254a4eeb1bd045a715f5476163591e8db2ffef1613780775c52b64c3b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_aarch64.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-musllinux_1_2_aarch64.whl
Size 6.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux musl 1.2+ ARM64
SHA-256 checksum
How to use checksums
98310107912b216d290362edda2fa6dfaa1426f82a6eedfbf3c4bf69a53207fa
BLAKE2b-256 checksum
How to use checksums
8e44048a4425aea832cafa38fab06da29821fb00ce8ca48e3f997c02e0d50268
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 6.0 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-64
SHA-256 checksum
How to use checksums
ea07ed7973461cd8644890cbaea04b48ffe492c01ec72fa9e5fdab4a4ff106dc
BLAKE2b-256 checksum
How to use checksums
c2840217ae3666e80f256c420195011dc9c226f2c3eaf4600c382bc709a3d187
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
Size 6.7 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ PowerPC 64-le
SHA-256 checksum
How to use checksums
4158c46ca9517d50b5816065f61be07374b9f1bfc5a85e4932428071254c61bd
BLAKE2b-256 checksum
How to use checksums
6e41bc61c45294b9794078274b0245717e4097219e7cb766205792eb13c9057b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-manylinux_2_17_i686.manylinux2014_i686.whl
Size 6.2 MB
Tags CPython 3.13 CPython 3.13 free-threading Linux glibc 2.17+ x86-32
SHA-256 checksum
How to use checksums
da3b01f7d7cf4f73311e6e685c899c4a4d25eb4009be7abc1e5c4c36963dec41
BLAKE2b-256 checksum
How to use checksums
2112ddd17cfaa72873b2fe729981a28025e8e2a0c098418b7c4d7af135564331
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-macosx_11_0_arm64.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-macosx_11_0_arm64.whl
Size 3.5 MB
Tags CPython 3.13 CPython 3.13 free-threading macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
7af456dd6b1e2d3f9ec6b76196ef62b3e082d980c96a6eeda762c27e62f2a674
BLAKE2b-256 checksum
How to use checksums
836044a5ba109be7d480834b6eb1744cfb8bfcbd5cd514bab511492ae836c478
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp313-cp313t-macosx_10_12_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp313-cp313t-macosx_10_12_x86_64.whl
Size 3.7 MB
Tags CPython 3.13 CPython 3.13 free-threading macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
dab9c3c2f15098cd06884b912c3b9301dc89833fe02fa22863321afffc3b745a
BLAKE2b-256 checksum
How to use checksums
e6113fc3b19370d08412e2bd3cb3f576e651d54d14836115233eb0be99b87499
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-win_amd64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-win_amd64.whl
Size 3.5 MB
Tags CPython 3.8 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
f5eb3e4c5bf7426dc65fc729d33a2fde84e9723ebbb66fd5309ac40a496cd6a6
BLAKE2b-256 checksum
How to use checksums
861c106fd31541e50d9d5a68f56d3cb738178848a81c34ebeed0fcbdb07f6f77
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_x86_64.whl
Size 6.6 MB
Tags CPython 3.8 Linux musl 1.2+ x86-64 abi3
SHA-256 checksum
How to use checksums
940e258f0df6f3641ac8d2828cfca67b5a65ae9588abaee28237c19817a5cecd
BLAKE2b-256 checksum
How to use checksums
4b83012c49842d4c9d2163b3a4dc429a761830c858ca36abf114ba1691caeee8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_i686.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_i686.whl
Size 6.4 MB
Tags CPython 3.8 Linux musl 1.2+ x86-32 abi3
SHA-256 checksum
How to use checksums
ebf138e805df5e1899af6d7a24e0b07043a4e9493e4ce471e42d326e50679a9d
BLAKE2b-256 checksum
How to use checksums
feacd9396ac1baad05729875ca71741e441924b40e014290f14e4b4e64cdea5b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_armv7l.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_armv7l.whl
Size 5.9 MB
Tags CPython 3.8 Linux musl 1.2+ ARMv7l abi3
SHA-256 checksum
How to use checksums
a29fddd4b420b361c1c126f08dec847155a881a7307d38c27869f8e0761c1573
BLAKE2b-256 checksum
How to use checksums
e11a75bedb49d40d54ec27708e6846644cf5416e68d4266b2ba7c23500801ea6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_aarch64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-musllinux_1_2_aarch64.whl
Size 6.9 MB
Tags CPython 3.8 Linux musl 1.2+ ARM64 abi3
SHA-256 checksum
How to use checksums
8b4da4bba7fe9b4a5ace31f668687d03809c1199716a54c39d2d43d922d1f7b3
BLAKE2b-256 checksum
How to use checksums
6fe0172081775c5007c16d4d614cd0792b5bce235ae3a6de90dce2d3078a079f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_armv7l.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_armv7l.whl
Size 5.6 MB
Tags CPython 3.8 Linux glibc 2.28+ ARMv7l abi3
SHA-256 checksum
How to use checksums
838b6ea8b51de77295c19fe9582597c079dc0b37bb20ec88b8ebafea69d08beb
BLAKE2b-256 checksum
How to use checksums
66fb5ca1b88ae8879129272816c185a5991c38e9215c085835d960250b8f388b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_aarch64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-manylinux_2_28_aarch64.whl
Size 6.5 MB
Tags CPython 3.8 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
74512e0a521701bbc160862dba2ddd7719d155bb98bccf460fbb9b277227d154
BLAKE2b-256 checksum
How to use checksums
e3f7293c774caf2dc2e1e69e90e1f80d42b0392bc1093fef2724c84a3b95d1ee
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_x86_64.manylinux_2_17_x86_64.whl
Size 6.2 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
816fe2f3ce2ca3f7f919bd0e460da5a9892997da988ee4bc261018975f867751
BLAKE2b-256 checksum
How to use checksums
5989c68a7218e1cc569ecab9ae2986f7e6310f6ed0bb3dd93f8a4eaa1323ab64
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_ppc64le.manylinux_2_17_ppc64le.whl
Size 6.8 MB
Tags CPython 3.8 Linux glibc 2.17+ PowerPC 64-le abi3
SHA-256 checksum
How to use checksums
f66da4a325910fa930dde968a49145b7546a2e995e4720c39ea881e49dc79a6e
BLAKE2b-256 checksum
How to use checksums
336926f822ba18e7060e2e7606900e968387f3de6036acd66167666e6f2bee0a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-manylinux2014_i686.manylinux_2_17_i686.whl
Size 6.4 MB
Tags CPython 3.8 Linux glibc 2.17+ x86-32 abi3
SHA-256 checksum
How to use checksums
2dd89a9769e525b95ac2950ddf6d2d44d241e4543e56d0b255064f6d5dfb898d
BLAKE2b-256 checksum
How to use checksums
6c2d59757ffd4a043708a08dcf9c09fdc66a3b6b0f0090b76bd0105dbf5e7264
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-macosx_11_0_arm64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-macosx_11_0_arm64.whl
Size 3.7 MB
Tags CPython 3.8 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
2a058b36ee8ad6518ff673f2141014ee43127ab21d50501db638282b3b0a0f9e
BLAKE2b-256 checksum
How to use checksums
dd262af436a275894a17d746032db61d1f4a72874669bf7dcfd85531027853fc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Release files / baseten_performance_client-0.1.18-cp38-abi3-macosx_10_12_x86_64.whl

Download URL baseten_performance_client-0.1.18-cp38-abi3-macosx_10_12_x86_64.whl
Size 3.8 MB
Tags CPython 3.8 abi3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
f371a02005f8ad30fa982f214bd78c5264688d740c02e18be503bfa6e90314a4
BLAKE2b-256 checksum
How to use checksums
557c82730c2dc475dd13c29bd50b6d33d0789fc8853ddeae2791b32017d8acf1
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via maturin/1.16.0

Security for baseten-performance-client 0.1.18

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1.18 This release

22 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page