commonmeta-rs (Python bindings)
PyO3 bindings exposing commonmeta-rs's list-command batch functions to
Python: VRAIX daily-dump fetch with local caching, lossless Parquet
read/write, and batched archive rendering. Records cross the FFI boundary as
plain JSON-shaped dicts — the same shape commonmeta-py's own readers and
writers already produce and consume.
Install
uv pip install commonmeta-rs
Requires CPython 3.14 or newer. The wheels are built against the stable ABI
(abi3-py314), so one wheel per platform also covers later 3.x releases.
commonmeta-py itself keeps a 3.9 floor; only this backend needs 3.14.
Development
The interpreter must be 3.14+, matching requires-python; an older venv fails
to build rather than falling back.
uv venv --python 3.14 .venv
uv pip install --python .venv/bin/python maturin pytest
source .venv/bin/activate
maturin develop
pytest tests/
Release
Releases are published by hand. PyPI trusted publishing only issues OIDC identities to GitHub, GitLab, Google Cloud and ActiveState, and this repo lives on Codeberg, so CI cannot authenticate to PyPI — the workflow builds and tests wheels only.
The version comes from [workspace.package] in the root Cargo.toml and is
shared with the commonmeta crate, so a wheel names the release it wraps. Bump
it there, not here.
Build one wheel per platform plus the sdist, then publish. Both wheels build on
the host — no Docker. The macOS wheel is a native build; the Linux
manylinux wheel cross-compiles with zig as the C
cross-linker (maturin --zig). All commands are
run from python/.
rm -rf dist
# One-time: the Linux cross target and zig (a pip package, no system install).
rustup target add x86_64-unknown-linux-gnu
uv pip install --python .venv/bin/python ziglang
# macOS (native — arm64 on Apple silicon)
maturin build --release --out dist
# Linux (manylinux2014 x86_64), cross-compiled with zig — no Docker, no emulation.
maturin build --release --out dist --target x86_64-unknown-linux-gnu --zig
# Source distribution (lets other platforms build from source as a fallback)
maturin sdist --out dist
uv publish --token "$PYPI_TOKEN" dist/*
Publishing from one machine uploads only the wheels present in dist/; any
platform without a wheel falls back to building from the sdist. To ship
binaries for more platforms (Windows, Intel macOS, Linux aarch64), add the
matching maturin build --target … invocations or collect the wheels-*
artifacts from the CI workflow into dist/ first.
API
fetch_vraix(source, date, input_path=None, limit=None, offset=0, cache_ttl_days=30) -> list[dict]Fetch records from a VRAIX daily dump (sourceis"crossref"or"datacite"). Withinput_path, reads a local SQLite file directly (no network); otherwise downloads{source}-{date}.sqlite3.zstfrom metadata.vraix.org, caching it locally forcache_ttl_days.write_parquet(records: list[dict]) -> bytesWrite records as a single lossless Parquet file.read_parquet(data: bytes) -> list[dict]Read records back from Parquet bytes written bywrite_parquet.write_archive(records: list[dict], to: str, base_name: str, batch_size=100_000) -> list[tuple[str, bytes]]Render records totoformat, split into batches of at mostbatch_sizerecords, returned as(entry_name, bytes)pairs ready to pack into a zip/tar archive.convert(from_: str, to: str, input: str) -> bytesConvert a single record between formats.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file commonmeta_rs-0.9.78.tar.gz.
File metadata
- Download URL: commonmeta_rs-0.9.78.tar.gz
- Upload date:
- Size: 834.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cff1db742d4f46659a9abdb7a168f558c67bd50144eea703a6ef442f5ddb50aa
|
|
| MD5 |
bb820bf775df6392eb80a7d6c8e094a2
|
|
| BLAKE2b-256 |
5f9fa74e373027f81d52638db95660d9b05d237c70ef1004a235703cd3a0924c
|
File details
Details for the file commonmeta_rs-0.9.78-cp314-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
File metadata
- Download URL: commonmeta_rs-0.9.78-cp314-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Upload date:
- Size: 15.2 MB
- Tags: CPython 3.14+, manylinux: glibc 2.17+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d48b4168c9c42294271b1c0cd48ba0b7e5a4b997cac3c1dac5d52afe4324093e
|
|
| MD5 |
0790b29636416bfde46de8683f88ab01
|
|
| BLAKE2b-256 |
76cf770d0b84bc7808f5c31898e18b53939cc093129ec521f53ae7ee521ef811
|
File details
Details for the file commonmeta_rs-0.9.78-cp314-abi3-macosx_11_0_arm64.whl.
File metadata
- Download URL: commonmeta_rs-0.9.78-cp314-abi3-macosx_11_0_arm64.whl
- Upload date:
- Size: 15.3 MB
- Tags: CPython 3.14+, macOS 11.0+ ARM64
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
83652c2461784a31aedb81292ba9d19d05af80e934a966c85235edf4a0d2777c
|
|
| MD5 |
ea640a9cbc7cb99b3732e88a8ee923ef
|
|
| BLAKE2b-256 |
f906ea524d98fcf58b4081e080d2f7a70433b71a32b212c8624199032a83187f
|
