Skip to main content

Modern CLI tool for querying Papertrail logs

Project description

paperctl

PyPI Python Version License: MPL 2.0 CI

Download logs from Papertrail. Built with Typer, httpx, and Pydantic.

Installation

Using uv (recommended):

uv tool install paperctl

Or with pip:

pip install paperctl

From source:

git clone https://github.com/jwmossmoz/paperctl.git
cd paperctl
uv pip install -e .

Quick Start

Set your Papertrail API token:

export PAPERTRAIL_API_TOKEN="your_token_here"

Pull logs from a single system:

paperctl pull web-1                    # Last hour to stdout
paperctl pull web-1 --output logs.txt  # Save to file
paperctl pull web-1 --since -24h       # Custom time range

Pull from multiple systems in parallel:

# Download from three systems at once
paperctl pull web-1,web-2,web-3 --output logs/

# Search across multiple systems
paperctl pull web-1,web-2,db-1 --query "error" --output errors/

# Works with any combination
paperctl pull prod-*,staging-* --since -1h --output recent/

When you specify multiple systems, paperctl downloads them in parallel with automatic rate limiting (Papertrail allows 25 requests per 5 seconds). Each system gets its own file in the output directory.

What It Does

  • Downloads logs from one or more Papertrail systems
  • Handles pagination automatically (no manual limit setting)
  • Respects API rate limits (25 requests per 5 seconds)
  • Runs parallel downloads when pulling from multiple systems
  • Parses relative times like -1h or 2 days ago
  • Outputs as text, JSON, or CSV

Commands

pull

Download logs from systems.

paperctl pull <system>[,<system>...] [OPTIONS]

Arguments:
  <system>              System name(s) or ID(s), comma-separated

Options:
  -o, --output PATH     Output file (single system) or directory (multiple)
  --since TEXT          Start time (default: -1h)
  --until TEXT          End time (default: now)
  -f, --format TEXT     Output format: text|json|csv (default: text)
  -q, --query TEXT      Search query filter

Examples:

# Single system
paperctl pull web-1
paperctl pull web-1 --output logs.txt
paperctl pull web-1 --query "error" --since -24h

# Multiple systems (parallel)
paperctl pull web-1,web-2,web-3 --output logs/
paperctl pull prod-api,prod-worker --query "500" --output errors/

search

Search logs with filters.

paperctl search [QUERY] [OPTIONS]

Options:
  -s, --system TEXT     Filter by system name or ID
  -g, --group TEXT      Filter by group name or ID
  --since TEXT          Start time
  --until TEXT          End time
  -n, --limit INTEGER   Maximum events
  -o, --output TEXT     Output format
  -F, --file PATH       Write to file

systems

List systems or show details.

paperctl systems list              # List all systems
paperctl systems show <id>         # Show system details

groups

List groups or show details.

paperctl groups list               # List all groups
paperctl groups show <id>          # Show group with systems

archives

Download historical archives.

paperctl archives list                        # List available archives
paperctl archives download <filename>         # Download archive

config

Manage configuration.

paperctl config show               # Show current config
paperctl config init               # Initialize config file

Configuration

Configuration is loaded from (highest priority first):

  1. CLI arguments
  2. Environment variable: PAPERTRAIL_API_TOKEN
  3. Local config: ./paperctl.toml
  4. Home config: ~/.paperctl.toml
  5. XDG config: ~/.config/paperctl/config.toml

Create ~/.paperctl.toml:

api_token = "your_token_here"
timeout = 30.0  # Optional: API timeout in seconds

Time Formats

Relative times:

  • -1h, -30m, -7d (ago)
  • 1h, 2d (future)

Natural language:

  • 1 hour ago, 2 days ago

ISO 8601:

  • 2024-01-01T00:00:00Z

Special:

  • now

Rate Limiting

Papertrail's API allows 25 requests per 5 seconds. When pulling from multiple systems, paperctl automatically:

  • Runs downloads in parallel
  • Tracks requests across all systems
  • Throttles to stay under the limit
  • Retries with backoff on 429 errors

You don't need to worry about rate limits or pagination. Just specify what you want and paperctl handles the rest.

Development

# Install with dev dependencies
uv pip install -e ".[dev]"

# Run tests
uv run pytest

# Run linters
uv run ruff check .
uv run mypy src

# Format code
uv run ruff format .

# Build package
uv build

# Install pre-commit hooks
uv run prek install

License

Mozilla Public License 2.0 - see LICENSE for details.

Links

Author

Jonathan Moss (jmoss@mozilla.com)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

paperctl-1.1.1.tar.gz (17.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

paperctl-1.1.1-py3-none-any.whl (28.9 kB view details)

Uploaded Python 3

File details

Details for the file paperctl-1.1.1.tar.gz.

File metadata

  • Download URL: paperctl-1.1.1.tar.gz
  • Upload date:
  • Size: 17.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for paperctl-1.1.1.tar.gz
Algorithm Hash digest
SHA256 c29c2776cc2ec15d112485ae5b35f816ecea392269587e64b873592acb31f9f4
MD5 76577f60da73e6bed9857d55b3c4fb29
BLAKE2b-256 9279394eb020bbcb85387ccee55ff1ffa628dc604e63441bc7982e9377f1902b

See more details on using hashes here.

Provenance

The following attestation bundles were made for paperctl-1.1.1.tar.gz:

Publisher: release.yml on jwmossmoz/paperctl

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file paperctl-1.1.1-py3-none-any.whl.

File metadata

  • Download URL: paperctl-1.1.1-py3-none-any.whl
  • Upload date:
  • Size: 28.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for paperctl-1.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 d1959e5c03a18bffcf0c5456f72ec34bb01bbdddb5f42ccf22ae3e901c22d7f7
MD5 f35f6eeae587954319b41aec50cad31a
BLAKE2b-256 429a10e91778df203fc6fa3e93b79b1b25099c8a59bba21a313704038b1ce7cd

See more details on using hashes here.

Provenance

The following attestation bundles were made for paperctl-1.1.1-py3-none-any.whl:

Publisher: release.yml on jwmossmoz/paperctl

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page