kglite-datasets

Docs PyPI crates.io License: MIT

Fetch-build-cache dataset loaders for kglite — pull a public registry, build it into a queryable kglite KnowledgeGraph, cache the result. Extracted from kglite::datasets into a standalone crate + wheel so the kglite engine links zero network code.

Bundled sources:

  • SEC EDGAR — quarterly index, bulk submissions, per-form fetchers, XBRL company facts.
  • Sodir — Norwegian Offshore Directorate registry.
  • Wikidata — dump download / cache orchestration (heavy ingestion stays engine-side).

Install

pip install kglite-datasets      # ships the loaders + Python interface; pulls kglite

The single wheel bundles the Rust loaders and the Python interface; the graph engine is reused from kglite (a runtime dependency), not forked.

Usage

Each loader fetches its source, builds it into a kglite KnowledgeGraph, and caches the result under a workdir — returning a graph ready to query:

# SEC EDGAR — name a form, a company, a span:
from kglite_datasets.sec import SEC
g = SEC.fetch(workdir, "13F-HR", "TSLA", years=2, user_agent="Name email@dom")

# Sodir (Norwegian Offshore Directorate):
from kglite_datasets import sodir
g = sodir.open(workdir)

# Wikidata truthy dump (cache-managed download + N-Triples build):
from kglite_datasets import wikidata
g = wikidata.open(workdir)

g.cypher_query("MATCH (c:Company) RETURN c.name LIMIT 5")

Importing sec never drags in sodir/wikidata's optional stack (lazy submodules), so the SEC path stays light.

Rust

Rust embedders use the crate-root modules directly (they mirror kglite's former api::datasets::<loader> surface): kglite_datasets::{sec, sodir, wikidata}.

Status

Alpha — extraction complete. Followed the codingest handover playbook: copy → prove parity → freeze goldens + bench baseline (while kglite still had its in-tree copy) → kglite removed its loaders (2026-07-16). With the in-tree copy gone, the frozen goldens (tests/goldens/) and the frozen bench baseline (benchmarks/baseline.json) are the sole oracles carrying that verified-correct authority forward.

Development

make gate        # CI-equivalent local gate: lint · build · test · determinism · bench-smoke
make lint        # cargo fmt --check + clippy -D warnings (+ ruff if installed)
make develop     # maturin develop — build the extension into the active venv
make pytest      # offline Python suite (live-API tests behind the `live` marker)

The Rust workspace: crates/kglite-datasets (engine-free loaders) + crates/kglite-datasets-py (PyO3 wrapper → the wheel). Loaders fetch → parse → emit CSV/blueprint/dump; the graph build reuses kglite's from_blueprint / load_ntriples. All tests are offline (recorded HTTP fixtures); live-API smokes are opt-in.

Links

Badges and links point at the initial 0.1.0 release; there are no prior published versions.

License

MIT © Kristian dF Kollsgård

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.1.15)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for kkollsg from gravatar.com kkollsg

Credits

Author: Kristian dF Kollsgård

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Provides Extra

arrow

Tags

knowledge-graph datasets sec-edgar wikidata sodir kglite cypher

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kglite_datasets-0.1.14.tar.gz (239.3 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

kglite_datasets-0.1.14-cp310-abi3-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.10+Windows x86-64

kglite_datasets-0.1.14-cp310-abi3-manylinux_2_28_aarch64.whl (1.9 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ ARM64

kglite_datasets-0.1.14-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

kglite_datasets-0.1.14-cp310-abi3-macosx_11_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

kglite_datasets-0.1.14-cp310-abi3-macosx_10_12_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file kglite_datasets-0.1.14.tar.gz.

File metadata

  • Download URL: kglite_datasets-0.1.14.tar.gz
  • Upload date:
  • Size: 239.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.14.tar.gz
Algorithm Hash digest
SHA256 0178ffaa817438b2b9e8dbc0dd3bb48978a87d876fbd84d019bd0769d1b6c38f
MD5 802f943e680ffc638f6557342fb9005a
BLAKE2b-256 bb32a87dace60e9ec7eccbf7c0a52cbb57b12e8df151bfe0f7f4661a871ef008

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14.tar.gz:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.14-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.14-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 213021eda4346aa66c0f7eaf7f6798d328400ec1b1f9409110bce8cf27519c7f
MD5 116b51b0756d7d397c600f5e5777bce3
BLAKE2b-256 3975743f171fd2e5593d1526f3e278cfed28191052f0fdfada99001044f35bf0

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14-cp310-abi3-win_amd64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.14-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.14-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 8be07ee105fa5f547340502f468ef407c22bab1be18138140f29cdc871e62402
MD5 17efb9f27190dfbaf89c87c6aad0546d
BLAKE2b-256 bc185c9b990e187af610657f05e943819f695254ce17b312836190d056214520

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.14-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.14-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 71c2add0f21bfb8d938db02f1dea60c3ea8c966bad7a734cfff9f27ef45bd86b
MD5 f1cfd405918ae956e846acad6b661982
BLAKE2b-256 c2f75fbf6982eb84dc71706b19f1d11b676685089826ffa91ade3fa072a0f1c6

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.14-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.14-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 3b6a72901552490f39696ac42a1b07805ed820084953b8a0f9b0a91042ab7574
MD5 b4f97cbb7d49f0ffde845a20565143c7
BLAKE2b-256 db38b58d51d7aafc5d49df8b01e0eeb64ffc566631d795855f9e975a98ed2667

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.14-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.14-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 e1838460de20998ae20e7c595d64493e7f6eba9144fa0d2af279b262a50049e4
MD5 bd90a9c3d925cf7f5c5d254fba4a570d
BLAKE2b-256 d0c29994d252fe0f9bc14a79071d4a508e307d447c862b97321e5c36e6f2e748

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.14-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.15

6 files

This release

0.1.14 This release

6 files

0.1.13

6 files

0.1.12

6 files

0.1.11

6 files

0.1.10

6 files

0.1.9

6 files

0.1.8

6 files

0.1.7

6 files

0.1.6

6 files

0.1.5

6 files

0.1.4

6 files

0.1.3

6 files

0.1.2

6 files

0.1.1

6 files

0.1.0

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page