Skip to main content

dirigent-parquet

The parquet format pack for dirigent: one codec, convert.arrow, trading parquet with the three text spellings convert.std already trades between.

From To What it does
parquet json, ndjson, csv Each row becomes one record, every value in its JSON spelling.
json, ndjson, csv parquet Each record becomes one row, under a schema inferred from the records.

The record model is convert.std's: a sequence of flat records. What parquet adds is types, and the codec is honest about them in both directions:

  • Writing infers one type per column -- boolean, int64, float64, or string -- from the records. Integers and floats unify to a float column, because JSON calls both a number; any other mix is refused naming the column. A column every row leaves null is written as a nullable string column. A csv source carries no types, so csv to parquet writes string columns and nothing else.
  • Reading gives every value its JSON spelling: timestamps, dates and times come back as ISO strings, decimals as strings, and a float that is NaN or infinite as null. A nested column, or one holding raw bytes, is refused naming it -- flattening is a reshape, and a reshape belongs to a jq step that knows what the flattening should mean.

A conversion is a storage-object operation, like storage.copy: it reads the object at source and writes the one at target, and neither side is ever a value the step carries. A run that means to look at the records reads them with storage.read.

The pack ships separately because convert.std is deliberately on the standard library and nothing else; this codec stands on pyarrow. Nothing else in the workspace may depend on it.

Release files for dirigent-parquet 0.16.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dirigent-parquet 0.16.2
File Size Uploaded
dirigent_parquet-0.16.2.tar.gz 5.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dirigent-parquet 0.16.2
File Interpreter ABI Platform
dirigent_parquet-0.16.2-py3-none-any.whl Python 3 none any Details

Total release size: 13.5 kB

Release files / dirigent_parquet-0.16.2.tar.gz

Download URL dirigent_parquet-0.16.2.tar.gz
Size 5.8 kB
Tags Source
SHA-256 checksum
How to use checksums
a667b3479b4c02bd98e1e4275d921acb3debbb8ab42a9d70c7557be609b4f713
BLAKE2b-256 checksum
How to use checksums
cd59e1328d709044e312463b3540ec371659a8e515e57312f9395d8a02cf7922
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 17, 2026.

Transparency log

Release files / dirigent_parquet-0.16.2-py3-none-any.whl

Download URL dirigent_parquet-0.16.2-py3-none-any.whl
Size 7.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
6e55c3541cdd29b6786e6735fa52fddd9a099b8d4f3b7531f458bf81d26917b2
BLAKE2b-256 checksum
How to use checksums
9595e370ec3e4cca17fb8708224c3fa018f1f47da66e08ad6922be67ee106e40
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 17, 2026.

Transparency log

Release history Release notifications | RSS feed

0.16.7

2 release files

0.16.6

2 release files

0.16.5

2 release files

0.16.4

2 release files

0.16.3

2 release files

This release

0.16.2 This release

2 release files

0.16.1

2 release files

0.16.0

2 release files

0.15.2

2 release files

0.15.1

2 release files

0.15.0

2 release files

0.14.1

2 release files

0.14.0

2 release files

0.13.0

2 release files

0.12.0

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.1

2 release files

0.9.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page