seeparquet

seeparquet is an interactive terminal browser for Parquet files. It follows the navigation and rendering conventions of seej while using PyArrow to read Parquet row groups in bounded batches.

Features

  • Browse records with the arrow keys or Enter
  • Start at an absolute row index without scanning skipped row groups
  • Filter records with safe expressions using the ex variable
  • Select a subset of columns
  • Inspect the Arrow schema and Parquet metadata
  • Reuse seej renderers and renderer plugins
  • Automatically unpack and render gzip/tar data stored in task_binary
  • Print a fixed number of rows in non-interactive scripts

Install

pip install seeparquet

From a source checkout, for development:

pip install -e '.[dev]'

Usage

# Interactive browsing
seeparquet data.parquet

# Start at row 1000
seeparquet data.parquet -I 1000

# Read only selected columns
seeparquet data.parquet -C id,messages

# Filter rows; repeat -c to combine expressions with AND
seeparquet data.parquet -c 'ex["status"] == "active"'
seeparquet data.parquet -c 'ex.score >= 0.8' -c 'len(ex.messages) > 2'

# Use a seej renderer for selected fields
seeparquet data.parquet -r messages=messages,conversation

# Inspect metadata and schema
seeparquet data.parquet --schema

# Print three matching rows and exit
seeparquet data.parquet --head 3 -R

# Decode task_binary into metadata.json, instruction.md, and other files
seeparquet tasks.parquet -C path,task_binary

# List seej renderers, including installed plugins
seeparquet --list-renderers

Keyboard shortcuts

  • Down, Right, or Enter: next matching row
  • Up or Left: previous loaded row
  • T: toggle rich/raw rendering
  • S: show Parquet schema and metadata
  • Q or X: quit

Filtering happens after rows are decoded. Column projection and row-index skipping are pushed into the Parquet reader.

Project links

Data verified by PyPI on
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for p81sunshine0128 from gravatar.com p81sunshine0128

Credits

Author: Jiaxing Liu

GitHub Statistics

Data verified by PyPI on 
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

MIT
View SPDX License List

Requires

Python >=3.9

Provides Extra

dev

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

seeparquet-0.1.0.tar.gz (14.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

seeparquet-0.1.0-py3-none-any.whl (14.6 kB view details)

Uploaded Python 3

File details

Details for the file seeparquet-0.1.0.tar.gz.

File metadata

  • Download URL: seeparquet-0.1.0.tar.gz
  • Upload date:
  • Size: 14.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for seeparquet-0.1.0.tar.gz
Algorithm Hash digest
SHA256 94681a06acb2fccb449667165aef20a26893e138b03b91b9333a0c42f49eaa1e
MD5 e1649ec7eea7f47c32de9eadbe54ca95
BLAKE2b-256 d2c7c47b0a5b83dbd08db343157af8ec3572603c1b4bf8e940a60f1e1d98cf8f

See more details on using hashes here.

Provenance

The following attestation bundles were made for seeparquet-0.1.0.tar.gz:

Publisher: publish.yml on p81sunshine/seeparquet

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file seeparquet-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: seeparquet-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 14.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for seeparquet-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5b454ae70d61637374bb5a688ffcb31f08ebd9ab6c43a0a330a67c20ba68e8ca
MD5 678ea6331ab9f20ebd873ffdc3c7d8ef
BLAKE2b-256 3b09a353e8639a4bc1def2a0cbffd072ecbf25eb88f22d45524de51bc82e0df8

See more details on using hashes here.

Provenance

The following attestation bundles were made for seeparquet-0.1.0-py3-none-any.whl:

Publisher: publish.yml on p81sunshine/seeparquet

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page