kglite-datasets

Fetch-build-cache dataset loaders for kglite — pull a public registry, build it into a queryable kglite KnowledgeGraph, cache the result. Extracted from kglite::datasets into a standalone crate + wheel so the kglite engine links zero network code.

Bundled sources:

SEC EDGAR — quarterly index, bulk submissions, per-form fetchers, XBRL company facts.
Sodir — Norwegian Offshore Directorate registry.
Wikidata — dump download / cache orchestration (heavy ingestion stays engine-side).

Install

pip install kglite-datasets      # ships the loaders + Python interface; pulls kglite

The single wheel bundles the Rust loaders and the Python interface; the graph engine is reused from kglite (a runtime dependency), not forked.

Usage

Each loader fetches its source, builds it into a kglite KnowledgeGraph, and caches the result under a workdir — returning a graph ready to query:

# SEC EDGAR — name a form, a company, a span:
from kglite_datasets.sec import SEC
g = SEC.fetch(workdir, "13F-HR", "TSLA", years=2, user_agent="Name email@dom")

# Sodir (Norwegian Offshore Directorate):
from kglite_datasets import sodir
g = sodir.open(workdir)

# Wikidata truthy dump (cache-managed download + N-Triples build):
from kglite_datasets import wikidata
g = wikidata.open(workdir)

g.cypher_query("MATCH (c:Company) RETURN c.name LIMIT 5")

Importing sec never drags in sodir/wikidata's optional stack (lazy submodules), so the SEC path stays light.

Rust

Rust embedders use the crate-root modules directly (they mirror kglite's former api::datasets::<loader> surface): kglite_datasets::{sec, sodir, wikidata}.

Status

Alpha — extraction complete. Followed the codingest handover playbook: copy → prove parity → freeze goldens + bench baseline (while kglite still had its in-tree copy) → kglite removed its loaders (2026-07-16). With the in-tree copy gone, the frozen goldens (tests/goldens/) and the frozen bench baseline (benchmarks/baseline.json) are the sole oracles carrying that verified-correct authority forward. See dev-docs/plans/dataset-loader-extraction.md.

Development

make gate        # CI-equivalent local gate: lint · build · test · determinism · bench-smoke
make lint        # cargo fmt --check + clippy -D warnings (+ ruff if installed)
make develop     # maturin develop — build the extension into the active venv
make pytest      # offline Python suite (live-API tests behind the `live` marker)

The Rust workspace: crates/kglite-datasets (engine-free loaders) + crates/kglite-datasets-py (PyO3 wrapper → the wheel). Loaders fetch → parse → emit CSV/blueprint/dump; the graph build reuses kglite's from_blueprint / load_ntriples. All tests are offline (recorded HTTP fixtures); live-API smokes are opt-in.

License

MIT © Kristian dF Kollsgård

Development Status
- 3 - Alpha
Intended Audience
- Developers
- Science/Research
Programming Language
- Python :: 3
- Rust
Topic
- Database
- Scientific/Engineering

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kglite_datasets-0.1.1.tar.gz (238.0 kB view details)

Uploaded Jul 28, 2026 Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl (1.9 MB view details)

Uploaded Jul 28, 2026 CPython 3.10+Windows x86-64

kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl (1.9 MB view details)

Uploaded Jul 28, 2026 CPython 3.10+manylinux: glibc 2.28+ ARM64

kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB view details)

Uploaded Jul 28, 2026 CPython 3.10+manylinux: glibc 2.17+ x86-64

kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl (1.8 MB view details)

Uploaded Jul 28, 2026 CPython 3.10+macOS 11.0+ ARM64

kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl (1.9 MB view details)

Uploaded Jul 28, 2026 CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file kglite_datasets-0.1.1.tar.gz.

File metadata

Download URL: kglite_datasets-0.1.1.tar.gz
Upload date: Jul 28, 2026
Size: 238.0 kB
Tags: Source
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1.tar.gz
Algorithm	Hash digest
SHA256	`61b0f5ce5084785a6219558786aadf01ce117d7b4dc3ff4350541a5442d13fcf`
MD5	`e2b146fc12c1078efe92a8a64c193a32`
BLAKE2b-256	`922d8b3e1aa099dc08793564c33db7e7d2fb9402d12becdcc78c03c64edbbff0`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1.tar.gz:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1.tar.gz
- Subject digest: 61b0f5ce5084785a6219558786aadf01ce117d7b4dc3ff4350541a5442d13fcf
- Sigstore transparency entry: 2272950215
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push

File details

Details for the file kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl.

File metadata

Download URL: kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl
Upload date: Jul 28, 2026
Size: 1.9 MB
Tags: CPython 3.10+, Windows x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl
Algorithm	Hash digest
SHA256	`9a130d9ab9b6444498abf542622edbc86f4b038b8bbf84aefe4e7c4bd951a927`
MD5	`32744603dc4b40101cebdc4233f76b7d`
BLAKE2b-256	`2095eeb7a42f44fc487b36cd0035c79fe2a3c3c1060cc678d5d2b1a0c0f61d96`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1-cp310-abi3-win_amd64.whl
- Subject digest: 9a130d9ab9b6444498abf542622edbc86f4b038b8bbf84aefe4e7c4bd951a927
- Sigstore transparency entry: 2272950450
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push

File details

Details for the file kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

Download URL: kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl
Upload date: Jul 28, 2026
Size: 1.9 MB
Tags: CPython 3.10+, manylinux: glibc 2.28+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm	Hash digest
SHA256	`945b7ecbec5e86c20aa2ff65a2aad87b9ad531ce52bf17864a8ad38005455f50`
MD5	`8ce4bb8c963034de61d6c9e3c1af2825`
BLAKE2b-256	`256f269aacef49f4616eadbe83dc0387e4e0bd74934d571445938e93ed735507`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1-cp310-abi3-manylinux_2_28_aarch64.whl
- Subject digest: 945b7ecbec5e86c20aa2ff65a2aad87b9ad531ce52bf17864a8ad38005455f50
- Sigstore transparency entry: 2272950269
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push

File details

Details for the file kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

Download URL: kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Upload date: Jul 28, 2026
Size: 2.0 MB
Tags: CPython 3.10+, manylinux: glibc 2.17+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`d30a63ee0ad58ef5231281fdd2d00dc450596487807cd6ca97346ca9738497c0`
MD5	`f0e0c74b8d74218b7df3afebaee66b52`
BLAKE2b-256	`5852ad4c76c70725924786117a3a8f138d3c380b04a86ccfa40a007e3b8243bf`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
- Subject digest: d30a63ee0ad58ef5231281fdd2d00dc450596487807cd6ca97346ca9738497c0
- Sigstore transparency entry: 2272950549
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push

File details

Details for the file kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

Download URL: kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl
Upload date: Jul 28, 2026
Size: 1.8 MB
Tags: CPython 3.10+, macOS 11.0+ ARM64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl
Algorithm	Hash digest
SHA256	`8fb8e8870dbd86e4358a085ceceac75ef15dc83cabe6fb7afc3bbeaccb23e02f`
MD5	`180123725cdb8dc369889fe3691b8a18`
BLAKE2b-256	`9a163c68d8c66879adeb3fccd381513f483129ef336c266b321d513512c65f2a`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1-cp310-abi3-macosx_11_0_arm64.whl
- Subject digest: 8fb8e8870dbd86e4358a085ceceac75ef15dc83cabe6fb7afc3bbeaccb23e02f
- Sigstore transparency entry: 2272950646
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push

File details

Details for the file kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

Download URL: kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl
Upload date: Jul 28, 2026
Size: 1.9 MB
Tags: CPython 3.10+, macOS 10.12+ x86-64
Uploaded using Trusted Publishing? Yes
Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm	Hash digest
SHA256	`c0979a0dd3959c3c7b5dd23513c4f6cc36114efe946b69b257e077df52e513ec`
MD5	`2e7b471dbd96e2bbea9f59375ff1129a`
BLAKE2b-256	`7254c48d685159363cca10c1b20b70e73bd4e65742d865e82b6dc53f6be4b8cd`

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Statement:
- Statement type: https://in-toto.io/Statement/v1
- Predicate type: https://docs.pypi.org/attestations/publish/v1
- Subject name: kglite_datasets-0.1.1-cp310-abi3-macosx_10_12_x86_64.whl
- Subject digest: c0979a0dd3959c3c7b5dd23513c4f6cc36114efe946b69b257e077df52e513ec
- Sigstore transparency entry: 2272950363
- Sigstore integration time: Jul 28, 2026
Source repository:
- Permalink: kkollsga/kglite-datasets@75308379a093862c3d78731a7ac16519a96a67b9
- Branch / Tag: refs/tags/v0.1.1
- Owner: https://github.com/kkollsga
- Access: public
Publication detail:
- Token Issuer: https://token.actions.githubusercontent.com
- Runner Environment: github-hosted
- Publication workflow: release.yml@75308379a093862c3d78731a7ac16519a96a67b9
- Trigger Event: push