kglite-datasets

Docs PyPI crates.io License: MIT

Fetch-build-cache dataset loaders for kglite — pull a public registry, build it into a queryable kglite KnowledgeGraph, cache the result. Extracted from kglite::datasets into a standalone crate + wheel so the kglite engine links zero network code.

Bundled sources:

  • SEC EDGAR — quarterly index, bulk submissions, per-form fetchers, XBRL company facts.
  • Sodir — Norwegian Offshore Directorate registry.
  • Wikidata — dump download / cache orchestration (heavy ingestion stays engine-side).

Install

pip install kglite-datasets      # ships the loaders + Python interface; pulls kglite

The single wheel bundles the Rust loaders and the Python interface; the graph engine is reused from kglite (a runtime dependency), not forked.

Usage

Each loader fetches its source, builds it into a kglite KnowledgeGraph, and caches the result under a workdir — returning a graph ready to query:

# SEC EDGAR — name a form, a company, a span:
from kglite_datasets.sec import SEC
g = SEC.fetch(workdir, "13F-HR", "TSLA", years=2, user_agent="Name email@dom")

# Sodir (Norwegian Offshore Directorate):
from kglite_datasets import sodir
g = sodir.open(workdir)

# Wikidata truthy dump (cache-managed download + N-Triples build):
from kglite_datasets import wikidata
g = wikidata.open(workdir)

g.cypher_query("MATCH (c:Company) RETURN c.name LIMIT 5")

Importing sec never drags in sodir/wikidata's optional stack (lazy submodules), so the SEC path stays light.

Rust

Rust embedders use the crate-root modules directly (they mirror kglite's former api::datasets::<loader> surface): kglite_datasets::{sec, sodir, wikidata}.

Status

Alpha — extraction complete. Followed the codingest handover playbook: copy → prove parity → freeze goldens + bench baseline (while kglite still had its in-tree copy) → kglite removed its loaders (2026-07-16). With the in-tree copy gone, the frozen goldens (tests/goldens/) and the frozen bench baseline (benchmarks/baseline.json) are the sole oracles carrying that verified-correct authority forward.

Development

make gate        # CI-equivalent local gate: lint · build · test · determinism · bench-smoke
make lint        # cargo fmt --check + clippy -D warnings (+ ruff if installed)
make develop     # maturin develop — build the extension into the active venv
make pytest      # offline Python suite (live-API tests behind the `live` marker)

The Rust workspace: crates/kglite-datasets (engine-free loaders) + crates/kglite-datasets-py (PyO3 wrapper → the wheel). Loaders fetch → parse → emit CSV/blueprint/dump; the graph build reuses kglite's from_blueprint / load_ntriples. All tests are offline (recorded HTTP fixtures); live-API smokes are opt-in.

Links

Badges and links point at the initial 0.1.0 release; there are no prior published versions.

License

MIT © Kristian dF Kollsgård

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.1.15)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for kkollsg from gravatar.com kkollsg

Credits

Author: Kristian dF Kollsgård

License expression

MIT
View SPDX License List

Requires

Python >=3.10

Provides Extra

arrow

Tags

knowledge-graph datasets sec-edgar wikidata sodir kglite cypher

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

kglite_datasets-0.1.10.tar.gz (239.0 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

kglite_datasets-0.1.10-cp310-abi3-win_amd64.whl (1.9 MB view details)

Uploaded CPython 3.10+Windows x86-64

kglite_datasets-0.1.10-cp310-abi3-manylinux_2_28_aarch64.whl (1.9 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.28+ ARM64

kglite_datasets-0.1.10-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB view details)

Uploaded CPython 3.10+manylinux: glibc 2.17+ x86-64

kglite_datasets-0.1.10-cp310-abi3-macosx_11_0_arm64.whl (1.8 MB view details)

Uploaded CPython 3.10+macOS 11.0+ ARM64

kglite_datasets-0.1.10-cp310-abi3-macosx_10_12_x86_64.whl (1.9 MB view details)

Uploaded CPython 3.10+macOS 10.12+ x86-64

File details

Details for the file kglite_datasets-0.1.10.tar.gz.

File metadata

  • Download URL: kglite_datasets-0.1.10.tar.gz
  • Upload date:
  • Size: 239.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for kglite_datasets-0.1.10.tar.gz
Algorithm Hash digest
SHA256 62a7638521ce6e83e472da818b2bc610a4ef0053be5ceeb0fdcdf04ccead8731
MD5 a01e3f90157e875f5f4f1f17907b930d
BLAKE2b-256 a1dfa5a9922637c9df21b417aab3a1f06645dcf0da48ed4f0efffd27e86197fc

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10.tar.gz:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.10-cp310-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.10-cp310-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 c18ea006e90717f11f8827e6cd510f4601b8d01d523303c5f8fe82874eb9992d
MD5 1eed2d48a9f13def277302404503af1a
BLAKE2b-256 2893b74be4b5d179d20f539b3b2ec6c1c9da7e9bc659310f07453f5a15f358d3

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10-cp310-abi3-win_amd64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.10-cp310-abi3-manylinux_2_28_aarch64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.10-cp310-abi3-manylinux_2_28_aarch64.whl
Algorithm Hash digest
SHA256 a4ea20c395b00f7e1bb2d7b77b4799a36e035a8bacef45d12f47c7d27d507c05
MD5 13eb0f2b5f541b18e1a2f9312eb5bf0a
BLAKE2b-256 dac1fba7d490a89502e0927f4199e3c14654c4e41fcfa706c7992fe6778fe72c

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10-cp310-abi3-manylinux_2_28_aarch64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.10-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.10-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 94e0248a34874c5bb266d2173c2cf61dc64864f9180b8d7657e2a50e038bc1ec
MD5 76bf553e8628b167c57a6a1f61149547
BLAKE2b-256 724e02715b7eba5f9a1ff5847b698bbee5ddc2101451409adbeb2d46cc7039a6

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.10-cp310-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.10-cp310-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 feb12cbbc575f3de64ff912ddb1b6d73671ba70cc247f86bfb6129f97b7c84c1
MD5 d41caa6b4e2011b357d527a6100eb812
BLAKE2b-256 bde3cf8887464c14f3cdad09fc24af049e8ab2156c86839884f58d0b26904451

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10-cp310-abi3-macosx_11_0_arm64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file kglite_datasets-0.1.10-cp310-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for kglite_datasets-0.1.10-cp310-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 3feec2e8f36f48d2397cc456e6b6775f7bf19dc9dc4cdeab1285763fef54c364
MD5 c9967cd7723cb231f73e3e9be152ca11
BLAKE2b-256 a09e751d17bac456aab31bb7d07997e1bb4c291618ca1517fcb17250373e863f

See more details on using hashes here.

Provenance

The following attestation bundles were made for kglite_datasets-0.1.10-cp310-abi3-macosx_10_12_x86_64.whl:

Publisher: release.yml on kkollsga/kglite-datasets

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.1.15

6 files

0.1.14

6 files

0.1.13

6 files

0.1.12

6 files

0.1.11

6 files

This release

0.1.10 This release

6 files

0.1.9

6 files

0.1.8

6 files

0.1.7

6 files

0.1.6

6 files

0.1.5

6 files

0.1.4

6 files

0.1.3

6 files

0.1.2

6 files

0.1.1

6 files

0.1.0

5 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page