Skip to main content

Python SDK for the TokenSaver API: pipelines, chat sessions, and pricing estimates

Project description

TokenSaver SDK

Python client for the TokenSaver API (POST /pipelines/run, RAG, chat sessions, pricing).
Only HTTP transport and response normalization run in this package; all pipeline logic stays on the server.

Documentation (public) : sign in to platform.tokensaver.fr, open your workspace, then the API Reference page (examples, parameters, SDK methods).

Installation

pip install tokensaver-sdk

Development inside the monorepo:

cd packages/sdk
python -m venv .venv && . .venv/bin/activate
pip install -e ".[dev]"

Maintainers with a clone of the private repository can read the long-form architecture notes at docs/ARCHITECTURE-SDK-TOKENSAVER.md (repo root). That path is not published on PyPI.

Configuration

  • api_key (required): TokenSaver API key (ts_...).
  • base_url (optional): API base URL; default https://platform.tokensaver.fr/api/v1.
  • provider_api_key (optional): LLM provider key (openai, anthropic, etc.) sent on every ask / run_pipeline when set here; takes precedence over organization keys stored in the database for that run only; never persisted by TokenSaver. You can also pass provider_api_key= on a single call.
from tokensaver_sdk import TokenSaver

ts = TokenSaver(api_key="ts_...")
# Local backend:
# ts = TokenSaver(api_key="ts_...", base_url="http://localhost:8000/api/v1")
# Default LLM key for all runs (optional):
# ts = TokenSaver(api_key="ts_...", provider_api_key="sk-...")

Pipeline calls (ask / run_pipeline)

ask() returns a RunResult (.text, .metrics, .trace, .context).
run_pipeline() returns the raw API JSON.

Module flags (off by default in the SDK, same as in the console):
use_cache, use_rag, use_compression, use_pii_filter, stream.

Advanced parameters (aligned with PipelineRunRequest / console) — passed through to the JSON body as-is:

Parameter Purpose
temperature LLM temperature (0–2).
rag_similarity_threshold RAG similarity threshold (0–1).
cache_similarity_threshold Semantic cache similarity threshold (0–1).
compression_level Compression level 1–5.
rag_options Dict: document_ids, top_k, query_image_url.
pii_options Dict: engine, strategy, confidence_threshold, entity_types, language, regex_fallback.
context_layers Canonical shape (instructions, knowledge, interaction, token_budget).
system_prompt, profile_context, workspace_instructions Legacy flat fields (if no context_layers).
provider_api_key SDK: ephemeral LLM key for this run; overrides DB keys; not persisted.

IDE helpers: from tokensaver_sdk import RagOptions, PiiOptions (TypedDict).

result = ts.ask(
    "Your question",
    provider="openai",
    model="gpt-4o",
    use_rag=True,
    rag_similarity_threshold=0.55,
    rag_options={"document_ids": ["uuid-doc"], "top_k": 8},
)

RAG (documents)

Method Role
rag_list_documents() Lists PDFs in the workspace.
rag_upload_document(path, …) Multipart upload (no wait). Raises ValidationError (RAG_FILE_NOT_FOUND) if the file is missing.
rag_get_document(id) Status / metadata.
rag_wait_document_ready(id, …) Wait for ingestion.
rag_upload_and_wait(path, …) Upload + wait.
rag_ensure_document(path, …) Reuses an already ingested file (same file name) or upload + wait.

Minimal example with a question over a PDF:

doc = ts.rag_ensure_document("handbook.pdf")
ts.ask(
    "What are the key points?",
    provider="openai",
    model="gpt-4o",
    use_rag=True,
    rag_options={"document_ids": [doc["document_id"]]},
)

Chat sessions

from tokensaver_sdk import HISTORY_NONE, HISTORY_LOCAL, HISTORY_SERVER

# Stateless (default for ask: history=HISTORY_NONE)
ts.ask("…", provider="openai", model="gpt-4o", history=HISTORY_NONE)

# Server-side persistence
session = ts.chat.session(history=HISTORY_SERVER, name="My chat")
session.ask("…", provider="openai", model="gpt-4o")

Cost estimate (no LLM call)

ts.estimate_cost(1200, 300, provider="openai", model="gpt-4o")

Errors

from tokensaver_sdk import ERROR_RAG_FILE_NOT_FOUND
from tokensaver_sdk.errors import (
    TokenSaverError,
    AuthenticationError,
    ProviderKeyMissingError,
    QuotaExceededError,
    RateLimitError,
    ValidationError,
    ServerError,
    TimeoutError,
)

HTTP errors map to these exceptions. For RAG uploads (rag_upload_document, rag_upload_and_wait, rag_ensure_document when a file is sent), a missing PDF path on the client raises ValidationError with code="RAG_FILE_NOT_FOUND" (compare to ERROR_RAG_FILE_NOT_FOUND); the raw payload includes "path" among other fields.

Tests & quality

pytest
ruff check src tests && ruff format src tests

Useful variables for integration tests: TOKENSAVER_API_KEY, base URL depending on your deployment.

Publishing to PyPI

  1. Version: bump __version__ in src/tokensaver_sdk/__init__.py (single source of truth for the build).
  2. Build & check: python -m build then twine check dist/* (dev deps: pip install -e ".[dev]").
  3. Upload: twine upload dist/* (PyPI username: __token__, password: your API token). Try TestPyPI first with --repository testpypi.
  4. CI: after adding the PYPI_API_TOKEN repository secret, pushing tag sdk-v0.1.0 (same as __version__) triggers the Publish SDK to PyPI workflow.

Further reference

  • TokenSaver console: platform.tokensaver.fr → your workspace → API Reference (examples, SDK method list).
  • Architecture & decisions: internal to the TokenSaver monorepo (docs/ARCHITECTURE-SDK-TOKENSAVER.md); not linked here because source repositories are private.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

tokensaver_sdk-0.1.3.tar.gz (15.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

tokensaver_sdk-0.1.3-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file tokensaver_sdk-0.1.3.tar.gz.

File metadata

  • Download URL: tokensaver_sdk-0.1.3.tar.gz
  • Upload date:
  • Size: 15.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokensaver_sdk-0.1.3.tar.gz
Algorithm Hash digest
SHA256 13805497b8175fae509179d050a825f2b17f02972c6ef4c9802b534029352bbb
MD5 2c48a20b052510849ce3438b86173db2
BLAKE2b-256 ffb28088f5512756e33d3ba758fecc30c9acc215f9639fcd72e11ca45947b52b

See more details on using hashes here.

File details

Details for the file tokensaver_sdk-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: tokensaver_sdk-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 12.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for tokensaver_sdk-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 707a16638b4625c38df1b03860ac1c014a512c7021c29831359dbdd5466c24c3
MD5 aa756b0cacdbfb577bc5b702c99a73fa
BLAKE2b-256 714da34bb86c39df051b5488df6365ac5c1b07a2206fc96957a48d23ea7e0ec1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page