Skip to main content

dtypeflow

dtypeflow is a terminal UI to convert a CSV file to Parquet.

Point it at a CSV file, and for each column it infers the tightest-fitting dtype (Boolean, unsigned/signed integers UInt8…UInt64/Int8…Int64, floats Float16/Float32/Float64, String, or Dictionary), shows the observed statistics, and lets you review or override the choice before writing the result to Parquet — all locally, no data leaves your machine.

Installation

uv tool install dtypeflow

Or with pipx:

pipx install dtypeflow

Or with pip:

pip install dtypeflow

Usage

Launch the picker and choose a CSV file interactively:

dtypeflow

Or pass a path directly to skip straight to configuring column types:

dtypeflow path/to/data.csv

The workflow has three steps:

  1. Pick a file — enter or browse for a CSV path.
  2. Configure types — for each column, review the recommended dtype, its stats (unique values, samples, range/precision/scale), and pick from compatible alternatives grouped by safety (Safe / Too small / Discouraged).
  3. Export — write the configured dataset to a Parquet file.

Development

This project uses uv for dependency management.

uv sync
uv run dtypeflow

Lint:

uv run --with ruff ruff check src/

License

MIT

Metadata

Release files for dtypeflow 1.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dtypeflow 1.0.0
File Size Uploaded Provenance
dtypeflow-1.0.0.tar.gz 20.7 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for dtypeflow 1.0.0
File Interpreter ABI Platform
dtypeflow-1.0.0-py3-none-any.whl Python 3 none any Details

Total release size: 55.1 kB

Release files / dtypeflow-1.0.0.tar.gz

Download URL dtypeflow-1.0.0.tar.gz
Size 20.7 kB
Tags Source
SHA-256 checksum
How to use checksums
e7395d4804512e3d2459ecd846e34a1e4a6d9083aebccca2e3931cbcb84d32f9
BLAKE2b-256 checksum
How to use checksums
c2f487999d2ce1e6ff1022969e9589346f9ab51e07e4fd5c09a8d475b8300d26
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.11 {"installer":{"name":"uv","version":"0.12.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Release files / dtypeflow-1.0.0-py3-none-any.whl

Download URL dtypeflow-1.0.0-py3-none-any.whl
Size 34.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a3ffecec44aab5127ab2de8701a3d1c02a1ae701f64909286af49d7c6064176f
BLAKE2b-256 checksum
How to use checksums
2e2d7b74677edf74630f6c1e2312e4b38f9390f23f6aa8656fe978ed09bebdc0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.11 {"installer":{"name":"uv","version":"0.12.11","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

Security for dtypeflow 1.0.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page