Skip to main content

dirigent-parquet

The parquet format pack for dirigent: one codec, convert.arrow, trading parquet with the three text spellings convert.std already trades between.

From To What it does
parquet json, ndjson, csv Each row becomes one record, every value in its JSON spelling.
json, ndjson, csv parquet Each record becomes one row, under a schema inferred from the records.

The record model is convert.std's: a sequence of flat records. What parquet adds is types, and the codec is honest about them in both directions:

  • Writing infers one type per column -- boolean, int64, float64, or string -- from the records. Integers and floats unify to a float column, because JSON calls both a number; any other mix is refused naming the column. A column every row leaves null is written as a nullable string column. A csv source carries no types, so csv to parquet writes string columns and nothing else.
  • Reading gives every value its JSON spelling: timestamps, dates and times come back as ISO strings, decimals as strings, and a float that is NaN or infinite as null. A nested column, or one holding raw bytes, is refused naming it -- flattening is a reshape, and a reshape belongs to a jq step that knows what the flattening should mean.

A conversion is a storage-object operation, like storage.copy: it reads the object at source and writes the one at target, and neither side is ever a value the step carries. A run that means to look at the records reads them with storage.read.

The pack ships separately because convert.std is deliberately on the standard library and nothing else; this codec stands on pyarrow. Nothing else in the workspace may depend on it.

Release files for dirigent-parquet 0.16.7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for dirigent-parquet 0.16.7
File Size Uploaded
dirigent_parquet-0.16.7.tar.gz 5.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for dirigent-parquet 0.16.7
File Interpreter ABI Platform
dirigent_parquet-0.16.7-py3-none-any.whl Python 3 none any Details

Total release size: 13.6 kB

Release files / dirigent_parquet-0.16.7.tar.gz

Download URL dirigent_parquet-0.16.7.tar.gz
Size 5.8 kB
Tags Source
SHA-256 checksum
How to use checksums
3c2a81539a751cf227fc2c0505c0cf8421a1887a57a142f7e1c8f49e1c78cf9f
BLAKE2b-256 checksum
How to use checksums
66a87a26d63411f32207e8e9ce4485765260462b5352ce796083d8d37380fca8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 19, 2026.

Transparency log

Release files / dirigent_parquet-0.16.7-py3-none-any.whl

Download URL dirigent_parquet-0.16.7-py3-none-any.whl
Size 7.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
30ba043609d76c10e5502cf5787bd3ee0ab09c3375ae08b0e08b593b9d6c19f6
BLAKE2b-256 checksum
How to use checksums
2e20e6ee9f937587158e7662fb49f0d37debeb30d25334dc89740c63a98c7fe0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via twine/7.0.0 CPython/3.13.14

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

PyPI Publish Attestation

PyPI verified that this artifact, at this checksum, originated from the publisher listed below.

Signed by GitHub Actions, verified by PyPI on Sep 19, 2026.

Transparency log

Release history Release notifications | RSS feed

This release

0.16.7 This release

2 release files

0.16.6

2 release files

0.16.5

2 release files

0.16.4

2 release files

0.16.3

2 release files

0.16.2

2 release files

0.16.1

2 release files

0.16.0

2 release files

0.15.2

2 release files

0.15.1

2 release files

0.15.0

2 release files

0.14.1

2 release files

0.14.0

2 release files

0.13.0

2 release files

0.12.0

2 release files

0.9.5

2 release files

0.9.4

2 release files

0.9.3

2 release files

0.9.2

2 release files

0.9.1

2 release files

0.9.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page