Skip to main content

Lakehouse Observability Platform

Project description

Lakefront

A terminal-based lakehouse observability platform for exploring and managing data sources from your command line.


About

Working with lakehouse data — Parquet files on local disk or S3, DuckDB queries, materialized views — usually means jumping between tools, writing throwaway scripts, or wrestling with heavyweight UIs. Lakefront puts it all in one place: a fast TUI and CLI for data engineers who live in the terminal.

Problems it solves:

  • No single tool for lakehouse exploration — Lakefront combines DuckDB-powered SQL querying, S3 source management, and dataset browsing in one cohesive interface.
  • Configuration sprawl — profiles let you switch between environments (local dev, staging, production S3) with a single command, keeping credentials out of your scripts.
  • Context switching — instead of firing up a Jupyter notebook or a GUI just to peek at a Parquet file, you stay in the terminal.

Examples

Initialise Lakefront

Bootstrap the ~/.lakefront directory structure and create a default profile:

uv run lakefront init

Config Management

# List all profiles
uv run lakefront config list

# Show config directories and paths
uv run lakefront config info

# Create a new profile
uv run lakefront config create --profile staging

# Inspect a profile's current settings
uv run lakefront config inspect --profile staging

# See which profile is active
uv run lakefront config get-active

# Switch to a different profile
uv run lakefront config set-active --profile staging

Secrets (S3 access keys etc.) can be written to the TOML profile or set via environment variables instead:

export LAKEFRONT_S3__ACCESS_KEY=...
export LAKEFRONT_S3__SECRET_KEY=...

Project Management

Projects are the top-level organisational unit in Lakefront. Each project lives in its own directory under ~/.lakefront/projects/ and can be pinned to a config profile.

~/.lakefront/projects/
└── my-project/
    ├── project.toml      ← metadata + pinned profile
    └── results/          ← analysis outputs
# List all projects
uv run lakefront projects list

# Create a new project
uv run lakefront projects create my-project -d "EDA on S3 parquet" -p staging

# Inspect a project
uv run lakefront projects inspect my-project

# Delete a project (prompts for confirmation)
uv run lakefront projects delete my-project
uv run lakefront projects delete my-project --yes

Source Management

Data sources are attached to a project and point to a local path or S3 prefix.

# Add a source
uv run lakefront projects source add -p my-project -n raw -k s3 --path s3://bucket/raw/
uv run lakefront projects source add -p my-project -n local -k local --path /data/parquet/

# Remove a source
uv run lakefront projects source remove -p my-project -n raw

TUI (Terminal User Interface)

The interactive TUI provides a rich, multi-pane interface for exploring and analyzing data without leaving the terminal.

Project

Project Screen

The main project workspace with a three-pane layout:

Left Pane — Data Sources:

  • Browse all attached sources with expandable tree view
  • View column names and data types inline
  • Quickly navigate between sources

Center Pane — SQL Editor & Results:

  • Tabbed SQL editor for writing and managing multiple queries
  • Syntax-highlighted editor with DuckDB SQL support
  • Ctrl+R: Execute query
  • Ctrl+N: Run query in a new results tab
  • Ctrl+S: Save script to disk
  • Ctrl+T: Create new editor tab
  • Ctrl+W: Close current tab
  • Results pane displays query output in scrollable tables

Right Pane — Profiler:

  • Live query execution statistics
  • Row counts, memory usage, and timing information

Explore Screen

Deep-dive analysis with statistical profiling and AI insights:

  • Statistical Profile: Automatic data profiling showing distribution, nulls, and cardinality
  • AI-Powered Insights: Ask questions about your dataset using LLM integration
  • Interactive Q&A: Type questions to get natural-language analysis and recommendations
  • Keyboard Shortcuts:
    • Ctrl+R or Enter: Submit question to AI
    • Q: Return to project screen

Navigation

  • Tab / Shift+Tab: Move focus between panes
  • Modal dialogs for source attachment and confirmations
  • Themed UI with multiple color schemes (configurable via profile settings)

Changelog

v0.7.1 (2026-04-27)

Fix

  • toml properties not being overriden by corresponding env vars

v0.7.0 (2026-04-26)

Feat

  • tui: support multiple tabs in editor and result panes

v0.6.0 (2026-04-26)

Feat

  • core: read analyzer row limit setting
  • tui: read theme setting from core section
  • core: add core config section

v0.5.1 (2026-04-26)

Refactor

  • tui: consolidate styles in app.tcss

v0.5.0 (2026-04-24)

Feat

  • tui: add explore action to result pane

v0.4.0 (2026-04-22)

Feat

  • data profile is presented on source selection
  • enable ai powered data source exploration
  • cli: add configuration profile delete and demo commands
  • add anthropic section to configuration model

Fix

  • analyzer mishandles bool types
  • typo on app title

Refactor

  • move data profiling and llm code to analyzer module
  • move data profiling code from tui to core.analyzer
  • split core.main responsibilities across submodules
  • core

v0.3.4 (2026-04-20)

Fix

  • tui: rebuild source list after attach and detach

v0.3.3 (2026-04-19)

Feat

  • add commitizen for automated changelog and versioning

Fix

  • Add a timeout for S3 source path existence check
  • Project init ignores sources if unable to reach them or their existence check fails

v0.3.0 (2026-04-19)

Feat

  • Add support for attaching S3 sources to a project

v0.2.2 (2026-04-18)

Feat

  • Local sources can be attached to and detached from a project during runtime (#4)
  • tui: basic source navigation and query execution
  • core: can attach and query csv, parquet and parquet datasets (#3)
  • tui: preliminary layout
  • core: project context registers sources for querying (#2)
  • wip: project lifecycle management (#1)

Refactor

  • core,cli: moving around and renaming things

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lakefront-0.7.1.tar.gz (23.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

lakefront-0.7.1-py3-none-any.whl (35.6 kB view details)

Uploaded Python 3

File details

Details for the file lakefront-0.7.1.tar.gz.

File metadata

  • Download URL: lakefront-0.7.1.tar.gz
  • Upload date:
  • Size: 23.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for lakefront-0.7.1.tar.gz
Algorithm Hash digest
SHA256 4994271468c472de84176de901ac78be6d8d2bd50e498127516707f927089ddf
MD5 c9b29ef8197afa7574552bc3c1f1f8ee
BLAKE2b-256 aae73830dc889e316894286af0a5f3eaacc9e9e7502206096a18b50a712016c6

See more details on using hashes here.

File details

Details for the file lakefront-0.7.1-py3-none-any.whl.

File metadata

  • Download URL: lakefront-0.7.1-py3-none-any.whl
  • Upload date:
  • Size: 35.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for lakefront-0.7.1-py3-none-any.whl
Algorithm Hash digest
SHA256 581829010fc547fc3f537413837206f389d14d7ec04fe527755f54e3b7c03f5e
MD5 d0718faedeff25088fd3d89b93ba8eb2
BLAKE2b-256 32466d63d8dd5ae4e7426ba94a75ec7065e60f3e4f1ba845af4fae36b7244ed6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page