Skip to main content

dirigent-parquet

The parquet format pack for dirigent: one codec, convert.arrow, trading parquet with the three text spellings convert.std already trades between.

From To What it does
parquet json, ndjson, csv Each row becomes one record, every value in its JSON spelling.
json, ndjson, csv parquet Each record becomes one row, under a schema inferred from the records.

The record model is convert.std's: a sequence of flat records. What parquet adds is types, and the codec is honest about them in both directions:

  • Writing infers one type per column -- boolean, int64, float64, or string -- from the records. Integers and floats unify to a float column, because JSON calls both a number; any other mix is refused naming the column. A column every row leaves null is written as a nullable string column. A csv source carries no types, so csv to parquet writes string columns and nothing else.
  • Reading gives every value its JSON spelling: timestamps, dates and times come back as ISO strings, decimals as strings, and a float that is NaN or infinite as null. A nested column, or one holding raw bytes, is refused naming it -- flattening is a reshape, and a reshape belongs to a jq step that knows what the flattening should mean.

A conversion is a storage-object operation, like storage.copy: it reads the object at source and writes the one at target, and neither side is ever a value the step carries. A run that means to look at the records reads them with storage.read.

The pack ships separately because convert.std is deliberately on the standard library and nothing else; this codec stands on pyarrow. Nothing else in the workspace may depend on it.

Release files for dirigent-parquet 0.16.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dirigent-parquet 0.16.0
File Size Uploaded
dirigent_parquet-0.16.0.tar.gz 5.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dirigent-parquet 0.16.0
File Interpreter ABI Platform
dirigent_parquet-0.16.0-py3-none-any.whl Python 3 none any Details

Total release size: 13.5 kB

Release files / dirigent_parquet-0.16.0.tar.gz

Download URL dirigent_parquet-0.16.0.tar.gz
Size 5.8 kB
Tags Source
SHA-256 checksum
How to use checksums
696c2d2800de4092a7809f1dc5c1cda18feb098222bc5fc36406a4afc1a2bb24
BLAKE2b-256 checksum
How to use checksums
4774eccf76cb2e59d8ff569801401751f5f80a54e0d3d93061d198cfc2241cf6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 16, 2026.

Transparency log

Release files / dirigent_parquet-0.16.0-py3-none-any.whl

Download URL dirigent_parquet-0.16.0-py3-none-any.whl
Size 7.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7f388866cd2d841c4284f192fc5e4a8df534c1de447bfadbe0a758bec2c7636e
BLAKE2b-256 checksum
How to use checksums
4372f633f3fe200e2e85c225c5dd4e8c41004b50b55acc965ea9a4d27d41db25
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 16, 2026.

Transparency log

Release history Release notifications | RSS feed

0.16.7

2 release files

0.16.6

2 release files

0.16.5

2 release files

0.16.4

2 release files

0.16.3

2 release files

0.16.2

2 release files

0.16.1

2 release files

This release

0.16.0 This release

2 release files

0.15.2

2 release files

0.15.1

2 release files

0.15.0

2 release files

0.14.1

2 release files

0.14.0

2 release files

0.13.0

2 release files

0.12.0

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.1

2 release files

0.9.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page