polars-marc21

This project provides a toolkit for efficiently processing bibliographic records encoded in MARC 21, which is a popular file format used to exchange bibliographic data between libraries. In particular, the command line tool marc21 allows efficient filtering of records and extraction of data into a rectangular schema. Since the extracted data is in tabular form, it can be processed with popular frameworks such as Polars or Tidyverse. In addition, the Python package polars-marc21 provides a Polars extension that allows you to use the query syntax to create a DataFrame, without using the command line.

marc21-rs is developed by the Metadata Department of the German National Library (DNB). It is used for data analysis and for automating metadata workflows (data engineering) as part of automatic content indexing.

The marc21 tool provides the following commands:

concat — Concatenate records from multiple inputs (alias cat)
count — Print the number of records in the input data (alias cnt)
dedup — Remove duplicate records from the input
describe — Creates a frequency table of all subfield codes
filter — Filter records that fulfill a specified condition
frequency — Compute a frequency table of values (alias freq)
glimpse — Print a dense preview of a data field
hash — Compute SHA-256 checksum of records
invalid — Output invalid records that cannot be decoded
partition — Partition records by values
print — Print records in human readable format
sample — Select a random permutation of records
split — Split the input into chunks of a given size

The polars-marc21 package uses the query engine to transform MARC21 records directly into a DataFrame:

>>> from polars_marc21 import scan_marc21
>>>
>>> filename = "DUMP.mrc.gz"
>>> query = "001, 075{ b | 2 == 'gndgen' }"
>>> header = "ppn,gndgen"
>>>
>>> df = scan_marc21(filename, query, header).collect()
>>> print(df)
shape: (7, 2)
┌───────────┬────────┐
│ ppn       ┆ gndgen │
│ ---       ┆ ---    │
│ str       ┆ str    │
╞═══════════╪════════╡
│ 118540238 ┆ p      │
│ 118572121 ┆ p      │
│ 118607626 ┆ p      │
│ 118632477 ┆ p      │
│ 040992020 ┆ u      │
│ 040992918 ┆ u      │
│ 040993396 ┆ u      │
└───────────┴────────┘

Check out the documentation to learn more about installing and using the tool.

Contributing

All contributors are required to "sign-off" their commits (using git commit -s) to indicate that they have agreed to the Developer Certificate of Origin.

This project uses a strict no AI / no LLM policy. Please do not use large language models (LLMs) to create issues, patches, pull requests, or comments. Although English is the preferred language, you are welcome to communicate in your native language.

License

This project is licensed under the European Union Public License 1.2.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

polars_marc21-0.2.0.tar.gz (63.1 kB view details)

Uploaded Jun 29, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

polars_marc21-0.2.0-cp314-cp314t-win_arm64.whl (695.0 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tWindows ARM64

polars_marc21-0.2.0-cp314-cp314t-win_amd64.whl (742.9 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tWindows x86-64

polars_marc21-0.2.0-cp314-cp314t-win32.whl (681.1 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tWindows x86

polars_marc21-0.2.0-cp314-cp314t-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded Jun 29, 2026 CPython 3.14tmusllinux: musl 1.2+ x86-64

polars_marc21-0.2.0-cp314-cp314t-musllinux_1_2_i686.whl (1.0 MB view details)

Uploaded Jun 29, 2026 CPython 3.14tmusllinux: musl 1.2+ i686

polars_marc21-0.2.0-cp314-cp314t-musllinux_1_2_armv7l.whl (1.1 MB view details)

Uploaded Jun 29, 2026 CPython 3.14tmusllinux: musl 1.2+ ARMv7l

polars_marc21-0.2.0-cp314-cp314t-musllinux_1_2_aarch64.whl (990.6 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmusllinux: musl 1.2+ ARM64

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (861.4 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.17+ x86-64

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_17_s390x.manylinux2014_s390x.whl (931.1 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.17+ s390x

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (888.4 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.17+ ppc64le

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (792.1 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.17+ ARMv7l

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (813.1 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.17+ ARM64

polars_marc21-0.2.0-cp314-cp314t-manylinux_2_5_i686.manylinux1_i686.whl (843.4 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmanylinux: glibc 2.5+ i686

polars_marc21-0.2.0-cp314-cp314t-macosx_11_0_arm64.whl (735.9 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmacOS 11.0+ ARM64

polars_marc21-0.2.0-cp314-cp314t-macosx_10_12_x86_64.whl (813.9 kB view details)

Uploaded Jun 29, 2026 CPython 3.14tmacOS 10.12+ x86-64

polars_marc21-0.2.0-cp39-abi3-win_arm64.whl (699.1 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+Windows ARM64

polars_marc21-0.2.0-cp39-abi3-win_amd64.whl (748.2 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+Windows x86-64

polars_marc21-0.2.0-cp39-abi3-win32.whl (686.2 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+Windows x86

polars_marc21-0.2.0-cp39-abi3-musllinux_1_2_x86_64.whl (1.1 MB view details)

Uploaded Jun 29, 2026 CPython 3.9+musllinux: musl 1.2+ x86-64

polars_marc21-0.2.0-cp39-abi3-musllinux_1_2_i686.whl (1.1 MB view details)

Uploaded Jun 29, 2026 CPython 3.9+musllinux: musl 1.2+ i686

polars_marc21-0.2.0-cp39-abi3-musllinux_1_2_armv7l.whl (1.1 MB view details)

Uploaded Jun 29, 2026 CPython 3.9+musllinux: musl 1.2+ ARMv7l

polars_marc21-0.2.0-cp39-abi3-musllinux_1_2_aarch64.whl (995.7 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+musllinux: musl 1.2+ ARM64

polars_marc21-0.2.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (866.8 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.17+ x86-64

polars_marc21-0.2.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whl (936.0 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.17+ s390x

polars_marc21-0.2.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl (895.0 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.17+ ppc64le

polars_marc21-0.2.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whl (798.9 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.17+ ARMv7l

polars_marc21-0.2.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (818.3 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.17+ ARM64

polars_marc21-0.2.0-cp39-abi3-manylinux_2_5_i686.manylinux1_i686.whl (849.4 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+manylinux: glibc 2.5+ i686

polars_marc21-0.2.0-cp39-abi3-macosx_11_0_arm64.whl (741.5 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+macOS 11.0+ ARM64

polars_marc21-0.2.0-cp39-abi3-macosx_10_12_x86_64.whl (819.5 kB view details)

Uploaded Jun 29, 2026 CPython 3.9+macOS 10.12+ x86-64

File details

Details for the file polars_marc21-0.2.0.tar.gz.

File metadata

Download URL: polars_marc21-0.2.0.tar.gz
Upload date: Jun 29, 2026
Size: 63.1 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: uv/0.11.25 {"installer":{"name":"uv","version":"0.11.25","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for polars_marc21-0.2.0.tar.gz
Algorithm	Hash digest
SHA256	`9f63a719582262587940a0f86a7874baa11535cc09aacdd6a3824cb6c5b475fc`
MD5	`8ad48b0e920c81a85fb3dcdee4ef0fd4`
BLAKE2b-256	`7466ba27c2c45807b1b81b7a396fc8f6e9b9bfe083583cc68d74c05fe218f39b`

Algorithm	Hash digest
SHA256	`c042f335c836276d6919e79f9afed075446db7034541e52b3e76672ced979e46`
MD5	`cca3c0aa3b9b1c055bfd9bad9f048ca6`
BLAKE2b-256	`2202df3fab4c61fda5496d25bbeb526ecfcc717c2727665aa44fe03fcd51843a`

Algorithm	Hash digest
SHA256	`f4e3137f86f4c3af998f53cff6c43e30b110089afea02641778a84042bff8531`
MD5	`9fb37e424551f76914b2762e5da7a65c`
BLAKE2b-256	`d194d0107426712f6b224f4e514b3bd65978aa75fa7d875df6e0fc7d832d9e45`

Algorithm	Hash digest
SHA256	`bc329f159b6dc582e90f2e885ce62811507da409bb5d8d017ced988357f0d5dd`
MD5	`9f61cfc7aa0fbfb51b230f5326616ece`
BLAKE2b-256	`ef6ecf2abfcc3a4d6f7ac92ffeed5f7ad6a40a7d2cf581f99ad933b76b12e244`

Algorithm	Hash digest
SHA256	`1aead135834a5786569bf97f82b9fd66c241792b9c8ce27d180ca77a53469909`
MD5	`f364da1bf4e3d432b3ed27f523fdf162`
BLAKE2b-256	`e812ac0770b6b759ec7bb66476a1f172c46389b43237162e9699bb1f46f09f7b`

Algorithm	Hash digest
SHA256	`5598804a6840cfcc17954b127bac8d01a876304ae4c9ce9c9880a965660ca10a`
MD5	`f8621563ad5197e09c2ed3b8fb970b40`
BLAKE2b-256	`9d6fe95c11504f2a1d2d06cb90e4b1860c4ccb0f655449615e0eae4e1cdf1e08`

Algorithm	Hash digest
SHA256	`c42593c1ea909e9b0ef45ad182a9f5f9c2c612ac0bc1685626894782a53693db`
MD5	`3586a91e347b63143bc980c78ddb8bcf`
BLAKE2b-256	`3faf75b0c0c999b78a9df79ae6b61da5540bc7d030ca3352fe2b29cdd841cedd`

Algorithm	Hash digest
SHA256	`543b2f003f4d98f856c2ea27b3d09b3698663894a5189a607414fbc1fab7b434`
MD5	`8dcd543a2c9b891f4ce9d3f86556a031`
BLAKE2b-256	`fede532c78884d7927eeb855a31157f1076a652b8cdcae622a5b31a6fa748402`

Algorithm	Hash digest
SHA256	`536113e6f036a98c961461c86c9f01e2d9f0a693fcfc6612962b421452aed9d3`
MD5	`ade2ddd0864dbcf49f506918b21e7183`
BLAKE2b-256	`3b7505760e257563590f2ac775ad8396c40a09880f5fdaa2a4c0f78ea02a81cc`

Algorithm	Hash digest
SHA256	`4159f697bb23362e13c2a837254db2f040e3763a055c8f9a61cb7e84c67a130f`
MD5	`ca97946c452d65a54a578460fb7f9c42`
BLAKE2b-256	`566c092d80b42d4c41efff9178b2548f13f07dff95c0535462ac11a5f105bd83`

Algorithm	Hash digest
SHA256	`8d3b68c53d19ad971597a45b4f457c102bc784c04ebaf64e328fc0d59ac62796`
MD5	`1da5f3dca4789109d10843a4a5556884`
BLAKE2b-256	`b1a1052221aa16c0568592e56bc76ed5495a42629dedfaf2067f72bd6518f1db`

Algorithm	Hash digest
SHA256	`3e83edb90a2b363b1e8760cc66d48e40f71dafa9524823da95c5083abee96532`
MD5	`421199ef0bd9c47f33fec3f4a65c47ed`
BLAKE2b-256	`5f8aa7ccd32c1b5dc297fb3ae83c53822c0d38fe611003b34723b0e0f0d75a79`

Algorithm	Hash digest
SHA256	`c754fc82787de9fbe3637793dc887ea78e1055232b581180626aa6e87a3b72b3`
MD5	`5159d340b09207dcec99b6dc6f5aa95c`
BLAKE2b-256	`c99d1b53031cb017a3823d4cc5a4f719f0aa017401a986c65634bca9794428e3`

Algorithm	Hash digest
SHA256	`ab1edf701252a1bbe7c998407d95433fb29c6b016145afa8c0825eb4cf1e073b`
MD5	`7a8b4e93694b6447fd26a86726865516`
BLAKE2b-256	`8588f370793fe539ca6f37a15d923a4a92126ca10f62e6bbebb74cfbeb02e8d4`

Algorithm	Hash digest
SHA256	`848633456c8bc1dcf9242046dbcef1ca4916b32a8a42d78f0b5af5ae2a2fcf0a`
MD5	`591b5c7b0caa557560790dcd9a0f6531`
BLAKE2b-256	`18298882f62cb3cf18bbb2f42f734fc152ae0e79b755792117e96a799a6080b6`

Algorithm	Hash digest
SHA256	`8080484f12fa4a87b1bd1450ab4e65395cf71d3e6bf9a44b2e38bd900193e544`
MD5	`5554199f4fa0473f000ad5db101e907c`
BLAKE2b-256	`121edce29f4a9c5121c8bdd97e2b2c7fd875d93db70d72718c1dca34333a51e8`

Algorithm	Hash digest
SHA256	`fb6036279fa063b98fbfc90e02b28e2459aea9a9e46eebb6e7df99273b6f8f70`
MD5	`118f5cafa8191a5f9b8f9b0810c7a656`
BLAKE2b-256	`9336e8ebd3e458ffbc725b46ceecf2d86476089225096a5ccbda0b6605d504ee`

Algorithm	Hash digest
SHA256	`823e95f38fb36409c87804d3d1116b72467b05d8abd514a5d5c6625da79a5933`
MD5	`d229cad052254abf3a43e09115491f2f`
BLAKE2b-256	`b1c45a8d8b7260a4885b22f03e13ef4816323aa9e00ad80c7468db08ad81d8a8`

Algorithm	Hash digest
SHA256	`a7e8e1c8eab93e5880edffbbb027c09400580194faf7779c1e1ba218aaf9af05`
MD5	`c6ed2790ecbb976610d7abe2fd6cfcd1`
BLAKE2b-256	`8ef6d6ba9772a6067c9c8c1f7c2702501c746578b8b8edf9e5f97280d883cf73`

Algorithm	Hash digest
SHA256	`10e10e24ae064e062aee49e1aff6d23775a00405af37199341542835ed96ec90`
MD5	`ea987ced4f789bd129907f1ee65d60a6`
BLAKE2b-256	`5659f1e8e7e2e2fa20ed5cb48bfcaa231f3f5ceb58f0922ee4ab18ebf52332a8`

Algorithm	Hash digest
SHA256	`3b47f8e75d90aaf07b6f822af8105981eb708435dd1538d2f864641f1139fcb6`
MD5	`0a72180ee3d996b7e200f127f01a18ac`
BLAKE2b-256	`c36d4918020e46a04d84f951d8603117c75d6a7a8c85a5c02e0cbe13beb93d3a`

polars-marc21 0.2.0

Contributing

License

Project links

Key dates

2 maintainers

Credits

License expression

Requires

Classifiers

Download files

Source Distribution

Built Distributions

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

File metadata

File hashes

File details

Algorithm	Hash digest
SHA256	`d131ccf5e803c15a908eaa88481af790b0138d13a6ab2258fc2bb6c5c3a6fa21`
MD5	`0a86ff4c3f0d176a9085a370b4458b21`
BLAKE2b-256	`0106f52f632435c9200a2587d722ef0153d2f30a4ba49ded43fcf945561aebb6`

Algorithm	Hash digest
SHA256	`fea90d8d2c37920491f81a5ccad11979237f92146f7588656bcd538519b1e316`
MD5	`a02f3f6c028b1597e2c57e73f524dfdb`
BLAKE2b-256	`99cce4679b07ef53204126c973caf501f7d93d23b2a7938deddda03eb1b25be9`

Algorithm	Hash digest
SHA256	`37eead96de28471e0a394fa3e8ca641acb610c7ab50ecd1f9e0990bc9af5e1be`
MD5	`b9f16e324f9adb11ec1236b455ca2c7b`
BLAKE2b-256	`f9979d3b71bc7bf0cc12d043d13a973f339a32efc124e81712e20c8cf49229cd`

Algorithm	Hash digest
SHA256	`fba939d7e07cd8637fd6643636e697b24487b5f5324b07e59a1a22c26fab7b61`
MD5	`52901839f1f500519ac1a2cb8051bd05`
BLAKE2b-256	`8db33da806a93a831340f3d74c687a3909950a51bcc795dc01823c58bcb4a745`

Algorithm	Hash digest
SHA256	`4059bb4d56f4e6e5c11def5df00f354bd90fba3036a3f323c4d03a866632a667`
MD5	`b218eb5f7dcd97660061ab9e62b00647`
BLAKE2b-256	`00d0e2e1fed561f669640e9c957bc32e962a8290c0faa16cf019f0ebf41ce5ed`

Algorithm	Hash digest
SHA256	`5819ec50ef8802178fa55d931e35fa13c445c77e3d1d6fc3fcc66f7c2d9ed73e`
MD5	`4bdbaa7eb3c583b417a04284e5a53e32`
BLAKE2b-256	`ca1fdb356dc497740172643cdfa856393f9500d836e16db7e02dd914c8ae6960`

Algorithm	Hash digest
SHA256	`5c86f0acd07fe974390cd77899f481892acf2d4c93df532ea37e19c393974a16`
MD5	`114269d6ce921a5cd797a041d2068e26`
BLAKE2b-256	`d737accafb35364b297b4df60b0647c4fbd486970f36615a7e70229928f1df73`

Algorithm	Hash digest
SHA256	`d9e9824d04865f57f43008b865aef77e82e377476b500f6cc14802a840cd7107`
MD5	`3941c301e989fdc8c4ec39f66257917f`
BLAKE2b-256	`d563d172bce7c4004534fed019c753e85625c1b45dd7c4eae2137bb0f388e23b`

Algorithm	Hash digest
SHA256	`9d9140618b4be440d189fa3b5a211306c8f207c194823355e9aea4a4bb110ea0`
MD5	`2748c281a00ef23821cdbe4f427dc588`
BLAKE2b-256	`b94e559a7e2f8dbbdad752f6cdfd90995fc8c9c5152af2ec45ab3606437f5a63`

Algorithm	Hash digest
SHA256	`c9b7f71c29a613e54a1fe7f964fbb1ffb5d8b6e67d2710e703ec3e4d83fd3a5d`
MD5	`31cefde09bf934696c338e9136c25cee`
BLAKE2b-256	`1d8dbac215b28a75079452c5f67f575e302ccc27d5c6577cb44383f2b18e7c3a`