Skip to main content

A user-authorized agent runtime that acquires data from arbitrary sources and delivers it to consuming applications.

Project description

datarep

A trusted local service that retrieves data from arbitrary sources on behalf of your application. Your app describes what data it wants — datarep figures out how to get it.

Quick start

pip install -e ".[dev]"
datarep init
export ANTHROPIC_API_KEY="sk-ant-..."
datarep start

Register your app and get an API key:

datarep app register my-app

Retrieve data:

curl -X POST http://127.0.0.1:7080/get \
  -H "Authorization: Bearer dr_<your-api-key>" \
  -H "Content-Type: application/json" \
  -d '{"source": "my_source", "query": "get recent records"}'

What it does

Instead of every app building its own integrations, datarep:

  • Manages credentials — encrypted storage, browser-based OAuth, automatic token refresh
  • Writes retrieval code — a Claude agent inspects sources and generates Python code dynamically
  • Executes in a sandbox — network and filesystem restrictions via macOS sandbox-exec
  • Caches as recipes — working code is saved for instant, deterministic replay
  • Authenticates apps — per-app API keys with source-level access control and audit logging

Users grant trust once (to datarep). Every consuming app gets safe data access through it.

Interfaces

Interface Use case
HTTP API (localhost:7080) Primary interface for all apps. Bearer token auth.
MCP server Native interface for agentic/LLM-powered apps.
CLI (datarep) Setup, source management, debugging.

Source types

Type Example Sandbox
local_db iMessage chat.db, WhatsApp, any SQLite No network. Read-only DB access.
rest_api Square, Gmail, Quickbooks Network restricted to source domain.
local_files Photos, documents, exports No network. Read-only directory access.

Integration guide

See docs/integration-guide.md for the full walkthrough: API reference, authentication, handling permissions, MCP setup, recipes, and code examples.

Development

pip install -e ".[dev]"
pytest

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

datarep-1.0.0.tar.gz (33.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

datarep-1.0.0-py3-none-any.whl (31.7 kB view details)

Uploaded Python 3

File details

Details for the file datarep-1.0.0.tar.gz.

File metadata

  • Download URL: datarep-1.0.0.tar.gz
  • Upload date:
  • Size: 33.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for datarep-1.0.0.tar.gz
Algorithm Hash digest
SHA256 db6300f47eea61cd160a55ebda4c4a4b3c800489f71e48c89a3a9f7069b32122
MD5 1a2a8b061cb8a27fc7590383e783aafc
BLAKE2b-256 2e449974f37da17a926a45aeea527e6ccc8aa305bcbb381495707cc3241f738e

See more details on using hashes here.

Provenance

The following attestation bundles were made for datarep-1.0.0.tar.gz:

Publisher: publish.yml on thyself-fyi/datarep

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file datarep-1.0.0-py3-none-any.whl.

File metadata

  • Download URL: datarep-1.0.0-py3-none-any.whl
  • Upload date:
  • Size: 31.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for datarep-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 874ccb9d934b7fdb18341ad8dd108c19dc8704aaee90cad1583c13ec754b4c40
MD5 d71f86299e4695ec00fc5cc95a38d408
BLAKE2b-256 45ff7a4c4f35e788041ac2ada1e64d44ab81e85a51b4af7d6797f05bb5cf56e9

See more details on using hashes here.

Provenance

The following attestation bundles were made for datarep-1.0.0-py3-none-any.whl:

Publisher: publish.yml on thyself-fyi/datarep

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page