Skip to main content

A set of easy to use convenient tools for deltalake tables.

Project description

Deltalake Tools

Introduction

A set of easy to use tools for deltalake, with a command line interface. You don't need this if you're already using delta-rs (deltalake).

Inspired by the Amazon AWS cli tool.

However, if you use pyspark and your distributed query engine requires a _last_checkpoint file, then this is an easy way to get just that.

Delta Table Commands currently supported:

  • compact
  • vacuum
  • create-checkpoint
  • table-version

Getting started

Install

pip install deltalake-tools

check out astral's rye, uv and ruff projects

(uv is a blazingly fast drop-in replacement for pip.)

uv install deltalake-tools

If you prefer rye:

rye add deltalake-tools

Usage

help

(.venv)) test-runner$ deltalake-tools table-version /tmp/delta_table_test
10
(.venv)) test-runner$

table-version

(.venv)) test-runner$ deltalake-tools -h
Usage: deltalake-tools [OPTIONS] COMMAND [ARGS]...

Options:
  --version   Show the version and exit.
  -h, --help  Show this message and exit.

Commands:
  compact
  create-checkpoint
  table-version
  vacuum
(.venv)) test-runner$

Contribute

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

deltalake_tools-0.1.2.tar.gz (19.9 kB view hashes)

Uploaded Source

Built Distribution

deltalake_tools-0.1.2-py3-none-any.whl (13.3 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page