kglite-datasets

Docs PyPI crates.io License: MIT

Fetch-build-cache dataset loaders for kglite — pull a public registry, build it into a queryable kglite KnowledgeGraph, cache the result. Extracted from kglite::datasets into a standalone crate + wheel so the kglite engine links zero network code.

Bundled sources:

  • SEC EDGAR — quarterly index, bulk submissions, per-form fetchers, XBRL company facts.
  • Sodir — Norwegian Offshore Directorate registry.
  • Wikidata — dump download / cache orchestration (heavy ingestion stays engine-side).

Install

pip install kglite-datasets      # ships the loaders + Python interface; pulls kglite

The single wheel bundles the Rust loaders and the Python interface; the graph engine is reused from kglite (a runtime dependency), not forked.

Usage

Each loader fetches its source, builds it into a kglite KnowledgeGraph, and caches the result under a workdir — returning a graph ready to query:

# SEC EDGAR — name a form, a company, a span:
from kglite_datasets.sec import SEC
g = SEC.fetch(workdir, "13F-HR", "TSLA", years=2, user_agent="Name email@dom")

# Sodir (Norwegian Offshore Directorate):
from kglite_datasets import sodir
g = sodir.open(workdir)

# Wikidata truthy dump (cache-managed download + N-Triples build):
from kglite_datasets import wikidata
g = wikidata.open(workdir)

g.cypher_query("MATCH (c:Company) RETURN c.name LIMIT 5")

Importing sec never drags in sodir/wikidata's optional stack (lazy submodules), so the SEC path stays light.

Rust

Rust embedders use the crate-root modules directly (they mirror kglite's former api::datasets::<loader> surface): kglite_datasets::{sec, sodir, wikidata}.

Status

Alpha — extraction complete. Followed the codingest handover playbook: copy → prove parity → freeze goldens + bench baseline (while kglite still had its in-tree copy) → kglite removed its loaders (2026-07-16). With the in-tree copy gone, the frozen goldens (tests/goldens/) and the frozen bench baseline (benchmarks/baseline.json) are the sole oracles carrying that verified-correct authority forward. See dev-docs/plans/dataset-loader-extraction.md.

Development

make gate        # CI-equivalent local gate: lint · build · test · determinism · bench-smoke
make lint        # cargo fmt --check + clippy -D warnings (+ ruff if installed)
make develop     # maturin develop — build the extension into the active venv
make pytest      # offline Python suite (live-API tests behind the `live` marker)

The Rust workspace: crates/kglite-datasets (engine-free loaders) + crates/kglite-datasets-py (PyO3 wrapper → the wheel). Loaders fetch → parse → emit CSV/blueprint/dump; the graph build reuses kglite's from_blueprint / load_ntriples. All tests are offline (recorded HTTP fixtures); live-API smokes are opt-in.

Links

Badges and links point at the initial 0.1.0 release; there are no prior published versions.

License

MIT © Kristian dF Kollsgård

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.1.15)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for kkollsg from gravatar.com kkollsg

Credits

Author: Kristian dF Kollsgård

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Provides Extra

arrow

Tags

knowledge-graph datasets sec-edgar wikidata sodir kglite cypher

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kglite_datasets-0.1.2.tar.gz (237.6 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

kglite_datasets-0.1.2-cp310-abi3-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.10+Windows x86-64

kglite_datasets-0.1.2-cp310-abi3-manylinux_2_28_aarch64.whl (1.9 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ ARM64

kglite_datasets-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

kglite_datasets-0.1.2-cp310-abi3-macosx_11_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

kglite_datasets-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file kglite_datasets-0.1.2.tar.gz.

File metadata

  • Download URL: kglite_datasets-0.1.2.tar.gz
  • Upload date:
  • Size: 237.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.2.tar.gz
Algorithm Hash digest
SHA256 7b2957dc932b48b5e306d664265fefc5a55eba2fb5ae203794a1d32d2051fccd
MD5 69e8c1db6325677e6825e9458e856ec1
BLAKE2b-256 781c883a43d0d1ce9e1b325e3c16616f1ffa17fb61849edba5b26637605f628f

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2.tar.gz:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.2-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.2-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 978bfc8f8e2258cf8bc0897aea6164da5b018f1775607d197940745086d6713a
MD5 dca930589ac7947172b611a0e5159fdd
BLAKE2b-256 cc30a6c04f941634db4b056037d3876525c5e365ffe86b3ef5209480b6430e17

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2-cp310-abi3-win_amd64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.2-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.2-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 a1b43122eba458a4246b755b28a10b544689afb0aa1b626503812e6fb33412a2
MD5 74214afe1be0e76a8638bda6f1a7af37
BLAKE2b-256 b477afcb26a2c6942205627cbd94af7b90ff81afacb9ddf547c9f4037bb73c4e

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 09ae894132b6bcda4aa991afef1c5488b618a9ed24f11fd2e952ab51341e1980
MD5 47bec3eb1efda837c055561512c6eb44
BLAKE2b-256 abfbcc6c08566a1e489b5560b4dca32d57164699e06692a5d58dc9eaad60f4e8

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.2-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.2-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 bfcd48863eecda734be777d351fc2fd05373452367fb485f1e95ac8a42af4ef4
MD5 af2a57db41ebc2f93076c9cd5d591f7d
BLAKE2b-256 ea6afae94004e0322304abb0f8a9b36713b8056281555c58932678b4ea3193ad

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 8ec7980e482f9f668b5bc49789136005a20ff104391171e684ab2fbd7b142b46
MD5 bbcc0edc8eb726643ab323d9ea05377b
BLAKE2b-256 a040519bc4bcbabe98e7c081251e53241b2a4aa443a51914eccd8064abcb73cb

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.2-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.15

6 files

0.1.14

6 files

0.1.13

6 files

0.1.12

6 files

0.1.11

6 files

0.1.10

6 files

0.1.9

6 files

0.1.8

6 files

0.1.7

6 files

0.1.6

6 files

0.1.5

6 files

0.1.4

6 files

0.1.3

6 files

This release

0.1.2 This release

6 files

0.1.1

6 files

0.1.0

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page