blq-cli 0.1.0

Buidl Log Query - capture and query build/test logs with DuckDB

blq - Build Log Query

A CLI tool for capturing, querying, and analyzing build/test logs using DuckDB and the duck_hunt extension. We pronouce blq like "bleak", as in we have bleak outlook on the outcome of our hunt through the logs.

Features

• Capture logs from commands, files, or stdin
• Query directly with SQL or simple filter syntax
• Structured output in JSON, CSV, or Markdown for agent integration
• Event references for drilling into specific errors
• Command registry for reusable build/test commands
• Run metadata - captures git, environment, system, and CI context
• MCP server for AI agent integration
• 60+ log formats supported via duck_hunt extension

Installation

pip install blq-cli

Initialize in your project (installs duck_hunt extension):

blq init                     # Basic init
blq init --mcp               # Also create .mcp.json for AI agents
blq init --detect --yes      # Auto-detect and register build/test commands
blq init --project myapp --namespace myorg  # Override project identification

Quick Start

# Query a log file directly
blq q build.log
blq q -s file_path,line_number,message build.log

# Filter with simple syntax
blq f severity=error build.log
blq f severity=error,warning file_path~main build.log

# Run and capture a command
blq run make -j8
blq run --json make test

# View recent errors
blq errors

# Drill into a specific error
blq event 1:3
blq context 1:3

Commands

Querying

Command	Description
blq query / blq q	Query log files or stored events
blq filter / blq f	Filter with simple key=value syntax
blq sql <query>	Run arbitrary SQL
blq shell	Interactive SQL shell

Capturing

Command	Description
blq run <cmd>	Run registered command and capture output
blq exec <cmd>	Execute ad-hoc command and capture output
blq import <file>	Import existing log file
blq capture	Capture from stdin

Viewing

Command	Description
blq errors	Show recent errors
blq warnings	Show recent warnings
blq event <ref>	Show event details (e.g., blq event 1:3)
blq context <ref>	Show log context around event
blq status	Show status of all sources
blq history	Show run history

Management

Command	Description
blq init	Initialize .lq directory
blq register	Register a reusable command
blq unregister	Remove a registered command
blq commands	List registered commands
blq prune	Remove old logs
blq formats	List available log formats
blq completions	Generate shell completions (bash/zsh/fish)

Query Examples

# Select specific columns
blq q -s file_path,line_number,severity,message build.log

# Filter with SQL WHERE clause
blq q -f "severity='error' AND file_path LIKE '%main%'" build.log

# Order and limit results
blq q -o "line_number" -n 10 build.log

# Output as JSON (great for agents)
blq q --json build.log

# Output as CSV
blq q --csv build.log

# Query stored events (no file argument)
blq q -f "severity='error'"

Filter Syntax

The blq filter command provides grep-like simplicity:

# Exact match
blq f severity=error build.log

# Multiple values (OR)
blq f severity=error,warning build.log

# Contains (LIKE)
blq f file_path~main build.log

# Not equal
blq f severity!=info build.log

# Invert match (like grep -v)
blq f -v severity=error build.log

# Count matches
blq f -c severity=error build.log

# Case insensitive
blq f -i message~undefined build.log

Structured Output for Agents

# JSON output with errors
blq run --json make

# Markdown summary
blq run --markdown make

# Quiet mode (no streaming, just results)
blq run --quiet --json make

Output includes event references for drill-down:

{
  "run_id": 1,
  "status": "FAIL",
  "errors": [
    {
      "ref": "1:1",
      "file_path": "src/main.c",
      "line_number": 15,
      "message": "undefined variable 'foo'"
    }
  ]
}

Command Registry

Register frequently-used commands:

# Auto-detect commands from build files (Makefile, package.json, etc.)
blq init --detect --yes

# Or register manually
blq register build "make -j8" --description "Build project"
blq register test "pytest -v" --timeout 600
blq register format "black ." --no-capture  # Skip log capture for fast commands

# Run by name
blq run build
blq run test

# Run without log capture (fast mode for CI/pre-commit)
blq run --no-capture format

# List registered commands
blq commands

Auto-detected build systems: Makefile, package.json (npm/yarn), pyproject.toml, Cargo.toml, go.mod, CMakeLists.txt, configure, build.gradle, pom.xml, Dockerfile, docker-compose.yml

Run Metadata

Each blq run automatically captures execution context:

Field	Description
hostname	Machine name
platform	OS (Linux, Darwin, Windows)
arch	Architecture (x86_64, arm64)
git_commit	Current commit SHA
git_branch	Current branch
git_dirty	Uncommitted changes present
environment	Captured env vars (PATH, VIRTUAL_ENV, etc.)
ci	CI provider info (auto-detected)

Query metadata with SQL:

blq sql "SELECT hostname, git_branch, environment['VIRTUAL_ENV'] FROM lq_events"

MCP Server

blq includes an MCP server for AI agent integration:

blq serve                    # stdio transport (Claude Desktop)
blq serve --transport sse    # HTTP/SSE transport

Tools available: run, query, errors, warnings, event, context, status, history, diff

See MCP Guide for details.

Global Options

Flag	Description
-V, --version	Show version number
-F, --log-format	Log format hint (default: auto)

Python API

blq provides a fluent Python API for programmatic access:

from blq import LogStore, LogQuery

# Open the repository
store = LogStore.open()

# Query errors with chaining
errors = (
    store.errors()
    .filter(file_path="%main%")
    .select("file_path", "line_number", "message")
    .order_by("line_number")
    .limit(10)
    .df()
)

# Filter patterns
store.events().filter(severity="error")              # exact match
store.events().filter(severity=["error", "warning"]) # IN clause
store.events().filter(file_path="%test%")            # LIKE pattern
store.events().filter("line_number > 100")           # raw SQL

# Query a log file directly (without storing)
events = (
    LogQuery.from_file("build.log")
    .filter(severity="error")
    .df()
)

# Aggregations
store.events().group_by("file_path").count()
store.events().value_counts("severity")

See Python API Guide for full documentation.

Storage

Logs are stored as Hive-partitioned parquet files:

.lq/
├── logs/
│   └── date=2024-01-15/
│       └── source=build/
│           └── 001_make_103000.parquet
├── raw/           # Optional raw logs (--keep-raw)
├── commands.yaml  # Registered commands
└── schema.sql     # SQL schema and macros

Documentation

See docs/ for detailed documentation:

• Getting Started
• Commands Reference
• Query Guide
• Python API Guide
• Integration Guide

License

MIT