Skip to main content

TUI for managing DuckLake datalakes

Project description

quacktui

A Python TUI for managing DuckLake datalakes. Browse your catalog, inspect table metadata, run SQL queries, and perform maintenance operations — all from your terminal.

Install

With uv (recommended)

uv tool install quacktui

With pip

pip install quacktui

From source

git clone https://github.com/arksigma/quacktui
cd quacktui
uv sync
uv run quacktui

Run it in Docker

A self-contained sandbox image bundles quacktui, an in-container MinIO, and a pre-seeded DuckLake demo catalog:

./testing/setup.sh                                    # default connection: duckdb-demo
./testing/setup.sh --connection duckdb-demo-readonly  # any quacktui flag passes through

When you're done:

./testing/teardown.sh             # stop + remove container
./testing/teardown.sh --volumes   # also wipe persisted config/history/state

MinIO console (optional) at http://localhost:9001 (creds: minioadmin/minioadmin).

Quickstart

Create a connections.toml file in your home directory:

[[connections]]
name = "demo"
type = "duckdb"
uri = "md:demo"

[connections.storage]
type = "s3"
bucket = "my-data"
endpoint = "http://localhost:9000"
access_key_id = "minioadmin"
secret_access_key = "minioadmin"

Then launch quacktui:

quacktui --connection demo

For DuckDB with local files:

[[connections]]
name = "local"
type = "duckdb"
database = "/path/to/database.duckdb"

[connections.storage]
type = "s3"
bucket = "local-bucket"
endpoint = "http://localhost:9000"

Features

Catalog Views

Browse and inspect your datalake with eight dedicated views:

  • Schema Browser — Explore tables and views organized by schema
  • Table Details — Inspect table structure, columns, constraints, and statistics
  • Snapshot Timeline — View table snapshot history and retention policies
  • File Inventory — List all data files backing a table
  • Partition Explorer — Navigate and manage table partitions
  • Schema Evolution — Track column additions, renames, and type changes over time
  • Health Dashboard — Monitor table health, data quality, and maintenance metrics
  • Catalog Database Info — View version, format configuration, and settings

Query Editor

Multi-tab SQL editor with the following capabilities:

  • Syntax highlighting for SQL and Python
  • Schema-aware autocomplete for table and column names
  • Query history stored in persistent SQLite
  • Saved query snippets for frequent operations
  • Result export to CSV, Parquet, JSON, or clipboard
  • Multiple concurrent queries with separate result tabs
  • Query timeline to review and re-run historical queries

Maintenance Operations

Perform five critical datalake maintenance tasks, all requiring explicit confirmation:

  1. Compaction — Consolidate small files into larger files to improve query performance and reduce file count
  2. Expire Snapshots — Remove old snapshots based on retention policies to free storage
  3. Delete Orphaned Files — Clean up unreferenced files in S3 storage
  4. Refresh Statistics — Update table statistics for query optimization
  5. Optimize Manifests — Reorganize manifest files (version-dependent, available when supported by catalog format)

Destructive operations require pressing Ctrl+Enter to confirm.

Safety

By default, quacktui operates in read-only mode. Pass the --allow-writes flag to enable mutations:

quacktui --connection demo --allow-writes

Without this flag, all write operations are disabled and maintenance ops are grayed out.

Catalog Backends

quacktui supports the following catalog backends via DuckLake's extension:

  • DuckDB (default, embedded)
  • PostgreSQL (remote)
  • SQLite (file-based)
  • MySQL (remote)

Specify the backend in connections.toml using the type field.

Storage

In v1, quacktui supports S3 and S3-compatible storage backends:

  • AWS S3
  • MinIO (local or remote)
  • Cloudflare R2
  • DigitalOcean Spaces
  • Any S3-compatible endpoint

Configure the storage endpoint, bucket, and credentials in the [connections.storage] section of connections.toml.

Configuration

Create a connections.toml file to define your datalake connections:

[[connections]]
name = "production"
type = "duckdb"
uri = "md:prod"

[connections.storage]
type = "s3"
bucket = "prod-data"
endpoint = "https://s3.amazonaws.com"
region = "us-east-1"
access_key_id = "YOUR_KEY"
secret_access_key = "YOUR_SECRET"

[[connections]]
name = "staging"
type = "postgresql"
host = "localhost"
port = 5432
database = "datalake"
user = "admin"
password = "secret"

[connections.storage]
type = "s3"
bucket = "staging-data"
endpoint = "http://minio:9000"

For more detailed configuration options, see docs/CONFIGURATION.md.

Keybindings

Navigate and control quacktui with these keyboard shortcuts:

Key Action
Ctrl+P Command palette (search and run commands)
Ctrl+T Theme switcher (dark/light)
F1 Help and keybindings
1 / 2 / 3 Switch between mode tabs (Catalog / Query / Maintenance)
Ctrl+Enter Execute SQL query or confirm destructive operation
Ctrl+N Open new query tab
Ctrl+W Close current tab
Ctrl+R Recall query from history
Tab Navigate between panes
Up / Down Navigate lists and history

Development

For development and contribution guidelines, see:

  • docs/CONTRIBUTING.md — How to contribute
  • docs/COMPATIBILITY.md — Supported versions and compatibility matrix
  • .sisyphus/plans/ducklake-tui.md — Current implementation status and milestones

License

Apache License 2.0. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

quacktui-0.1.2.tar.gz (259.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

quacktui-0.1.2-py3-none-any.whl (88.3 kB view details)

Uploaded Python 3

File details

Details for the file quacktui-0.1.2.tar.gz.

File metadata

  • Download URL: quacktui-0.1.2.tar.gz
  • Upload date:
  • Size: 259.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for quacktui-0.1.2.tar.gz
Algorithm Hash digest
SHA256 ea3e27d084ec41e1df890fe98e934fca3e16424ded1538daa6eb8bbc8df424ac
MD5 ae2acc90def2b7fdee51c57762b4a8e7
BLAKE2b-256 7a32d6b53d3185cd1f8488be206e474931f541fb22f109701cd61632b59cc3cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for quacktui-0.1.2.tar.gz:

Publisher: publish.yml on arksigma/quacktui

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file quacktui-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: quacktui-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 88.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for quacktui-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 13ce2304d2aee3c2a0d826110709da9b786dbf5454d459d77fff848d85bef683
MD5 4c9d3b8ba3f061eaf219113bf17e77a2
BLAKE2b-256 cd4cb4fbd637345b394946d80b8960d05282b960ccfe26f2a7d9779b1f8f1bed

See more details on using hashes here.

Provenance

The following attestation bundles were made for quacktui-0.1.2-py3-none-any.whl:

Publisher: publish.yml on arksigma/quacktui

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page