Skip to main content

Configurable cross-source log capture, search, and analysis CLI.

Project description

paperbark

Configurable cross-source log capture, search, and analysis CLI.

Paperbark captures logs from many sources (Fly.io, Cloudflare, Kubernetes, CloudWatch, plain files, stdin), runs a configurable set of probes over them, and writes a stable run-directory layout that downstream tooling can search across.

Status: v0.1.1 released to PyPI. The probe, format, source (flyctl), iteration, aggregate, cursor-filter, search, dispatcher, and analyse layers are all wired up; paperbark monitor runs end to end on a configurable cadence with a rich.live ticker. See docs/ROADMAP.md for current status.

Install

# pipx (recommended for CLI use)
pipx install paperbark

# or uv
uv tool install paperbark

For local development, see CONTRIBUTING.md.

Quickstart

# write a starter config in the current directory
paperbark init

# add at least one source — uncomment the [[sources]] block in
# paperbark.toml and point `app` at your Fly app. monitor exits with
# "no sources configured" until you do.

# capture and analyse using config defaults (3s cadence, ~72 minutes)
paperbark monitor

# custom cadence, fixed run id, snapshots every 30s
paperbark monitor --interval 1s --run-id incident-pr349 --analyse-every 30s

# capture forever; press Ctrl+C to write the final report and exit
paperbark monitor --iterations 0

# search across captured runs
paperbark search --keyword "panic"

# re-run analysis over an existing run
paperbark analyse --run latest

Configuration

Paperbark reads ./paperbark.toml first, then ~/.config/paperbark/config.toml. Every CLI flag is also expressible as a TOML key; flags override TOML at runtime. See docs/CONFIG.md for the full schema reference.

Sources

Source Status
Fly.io (flyctl logs) implemented
Cloudflare Workers (wrangler tail) stub (interface only, post-v1)
Kubernetes (kubectl logs) stub (interface only, post-v1)
AWS CloudWatch stub (interface only, post-v1)
Plain files stub (interface only, post-v1)
stdin stub (interface only, post-v1)

See docs/SOURCES.md for the Source interface and how to add a new one.

Log payload formats

Today: JSON-keyed payloads only. Per-source format_keys lets you remap the canonical field names (timestamp / level / message / component) to whatever JSON keys your app emits — see docs/CONFIG.md.

Coming in v0.2: regex named-group formats for non-JSON shapes (pipe-delimited, syslog, Apache combined, nginx default, or any custom pattern). The format layer already ships three presets (apache-combined, nginx-default, syslog-rfc5424); they're not yet wired into iteration. Until then, non-JSON sources will trip the format-mismatch warning and probes will produce no findings.

Probes

Severity rollup, panics and fatals, HTTP status, latency (p50/p95/p99), heartbeat gap detection, process health, autoscaler events, database/external errors, Sentry events, plus ad-hoc keyword and regex matches. Each probe is config-toggleable; regex sets are config-overridable. See docs/PROBES.md for the full list, finding shapes, and how to add one.

Licence

MIT — see LICENSE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

paperbark-0.1.2.tar.gz (99.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

paperbark-0.1.2-py3-none-any.whl (77.3 kB view details)

Uploaded Python 3

File details

Details for the file paperbark-0.1.2.tar.gz.

File metadata

  • Download URL: paperbark-0.1.2.tar.gz
  • Upload date:
  • Size: 99.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for paperbark-0.1.2.tar.gz
Algorithm Hash digest
SHA256 b2f6f5a697a491f8b9d5b95aaf239d1ea6ecfccdf7285ebf89ed4ef89f20806d
MD5 2838dab2395b1dd2d924fc0127069ac4
BLAKE2b-256 8781a41664527722bd146b54064b08c9c2b297e4eac5b1306d4404c2de1e79da

See more details on using hashes here.

Provenance

The following attestation bundles were made for paperbark-0.1.2.tar.gz:

Publisher: publish.yml on Good-Native/paperbark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file paperbark-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: paperbark-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 77.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.13

File hashes

Hashes for paperbark-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 5671129817752e742a40d34fa34d98a264f4e485c2f80c295286dc900f447a52
MD5 1428f1e05ddab33d3102b876ce380294
BLAKE2b-256 ca72ba825254fdfd4ed9f5d38fc6dbd68b6b5f8d1d5b0aeb0fa6e991694e1018

See more details on using hashes here.

Provenance

The following attestation bundles were made for paperbark-0.1.2-py3-none-any.whl:

Publisher: publish.yml on Good-Native/paperbark

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page