Skip to main content

Append-only local ingest and queryable storage for Runopsy traces

Project description

runopsy-collector

Local, append-only ingest for normalized trace events.

Storage has two layers and they are not equal partners. The JSONL journal is the source of truth: one append-only file per run, written with sorted keys so the same run always serializes to the same bytes. DuckDB is a derived index built from those journals to make runs queryable, and it can be thrown away and rebuilt at any time with Collector.rebuild().

That asymmetry is deliberate. An agent run fails at unpredictable moments, often taking the process with it, and a half-written database is a far more likely outcome than a half-written append. Keeping the plain log authoritative means a crashed run is still diagnosable, a corrupted index is a one-command repair rather than lost history, and a user can read their own trace with nothing but a text editor.

Ingest is idempotent on event_id, so an adapter that retries a write cannot duplicate a step and inflate a loop detector's count.

Nothing here reaches the network. Content is referenced by hash, and the contains_secret flag travels with each event so export and payload minimization can consult it before anything leaves the machine.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

runopsy_collector-0.1.3.tar.gz (23.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

runopsy_collector-0.1.3-py3-none-any.whl (29.4 kB view details)

Uploaded Python 3

File details

Details for the file runopsy_collector-0.1.3.tar.gz.

File metadata

  • Download URL: runopsy_collector-0.1.3.tar.gz
  • Upload date:
  • Size: 23.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for runopsy_collector-0.1.3.tar.gz
Algorithm Hash digest
SHA256 2f00f8bbba3862f9352d087f01263f849207f3d722499944441552732028df7d
MD5 673ff0a58b8d39de095bed1e806043bf
BLAKE2b-256 06a23d9a07eaa0e216dd534caa7081762baecaf11154b7d6febe06039114b37a

See more details on using hashes here.

File details

Details for the file runopsy_collector-0.1.3-py3-none-any.whl.

File metadata

  • Download URL: runopsy_collector-0.1.3-py3-none-any.whl
  • Upload date:
  • Size: 29.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.12.0 {"installer":{"name":"uv","version":"0.12.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":null,"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for runopsy_collector-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 6fc7945dbe1bd0cd738358b63aa368a6598040c26ec090a07c57c58a231c8e27
MD5 b0a306463d73e82de37c562e324571db
BLAKE2b-256 4ddccb082d30ecf009c00846fb9ebab7113285c2e1b318d77dd9e2bcbc59fe04

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page