Skip to main content

dirigent-parquet

The parquet format pack for dirigent: one codec, convert.arrow, trading parquet with the three text spellings convert.std already trades between.

From To What it does
parquet json, ndjson, csv Each row becomes one record, every value in its JSON spelling.
json, ndjson, csv parquet Each record becomes one row, under a schema inferred from the records.

The record model is convert.std's: a sequence of flat records. What parquet adds is types, and the codec is honest about them in both directions:

  • Writing infers one type per column -- boolean, int64, float64, or string -- from the records. Integers and floats unify to a float column, because JSON calls both a number; any other mix is refused naming the column. A column every row leaves null is written as a nullable string column. A csv source carries no types, so csv to parquet writes string columns and nothing else.
  • Reading gives every value its JSON spelling: timestamps, dates and times come back as ISO strings, decimals as strings, and a float that is NaN or infinite as null. A nested column, or one holding raw bytes, is refused naming it -- flattening is a reshape, and a reshape belongs to a jq step that knows what the flattening should mean.

A conversion is a storage-object operation, like storage.copy: it reads the object at source and writes the one at target, and neither side is ever a value the step carries. A run that means to look at the records reads them with storage.read.

The pack ships separately because convert.std is deliberately on the standard library and nothing else; this codec stands on pyarrow. Nothing else in the workspace may depend on it.

Release files for dirigent-parquet 0.15.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dirigent-parquet 0.15.1
File Size Uploaded
dirigent_parquet-0.15.1.tar.gz 5.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dirigent-parquet 0.15.1
File Interpreter ABI Platform
dirigent_parquet-0.15.1-py3-none-any.whl Python 3 none any Details

Total release size: 13.5 kB

Release files / dirigent_parquet-0.15.1.tar.gz

Download URL dirigent_parquet-0.15.1.tar.gz
Size 5.8 kB
Tags Source
SHA-256 checksum
How to use checksums
855bee3656127bd4666037fa83ba3973083acd890f8c92637df13cb476f464e6
BLAKE2b-256 checksum
How to use checksums
30a89c3fc1d3f08f6a663f85c829dd32ef217e117298a61d45f4a65b7b8d3824
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 11, 2026.

Transparency log

Release files / dirigent_parquet-0.15.1-py3-none-any.whl

Download URL dirigent_parquet-0.15.1-py3-none-any.whl
Size 7.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
ce45b885c4b0b8afaac9a9c3e7a4a125a9aaa0c5736b2483f6f57ef7ce367b37
BLAKE2b-256 checksum
How to use checksums
93faf2be743e30bd3e7d74b17bf41598cbf2189950ec2ae1ee824673f328c3e2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 11, 2026.

Transparency log

Release history Release notifications | RSS feed

0.16.7

2 release files

0.16.6

2 release files

0.16.5

2 release files

0.16.4

2 release files

0.16.3

2 release files

0.16.2

2 release files

0.16.1

2 release files

0.16.0

2 release files

0.15.2

2 release files

This release

0.15.1 This release

2 release files

0.15.0

2 release files

0.14.1

2 release files

0.14.0

2 release files

0.13.0

2 release files

0.12.0

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.1

2 release files

0.9.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page