Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.3.1.tar.gz
(140.1 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.3.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0819aecebd720128c24386c657e08381bec9b5adc4a15cb4b06eb6e1313f96a |
|
MD5 | cc2c0109c66dae24a99e5413ca829fc1 |
|
BLAKE2b-256 | cf550f7bd38e8dc7cc6ae8afdac184e7a73abc7d000553c8ee1cb929efb37d75 |
Close
Hashes for kgdata-6.3.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8fd638f29b6bcf91bf50294d1ffb367079a3ffaf266f14bebce5f1878c141c5b |
|
MD5 | 77853381374edb87ba6b00b41cffa600 |
|
BLAKE2b-256 | 42d5630b6219639fd6adfca546bb19d51cd0e91d2bcde57b5e593949d2e003cf |
Close
Hashes for kgdata-6.3.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7bbdd3b9087d0f89baa507b573ab8beab1ed8b32427b2c4340e3a4f6966887e3 |
|
MD5 | f514fc24c1d346fb9d3058705f7f9015 |
|
BLAKE2b-256 | 4cd757442929767b01a7022f1f419a982b8de13b4f79edd72ae2b3dbaff0000b |
Close
Hashes for kgdata-6.3.1-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c55d356038b71c109f1061f704b956e7a3b89261211b2152b6750fee3a622ad5 |
|
MD5 | 4f58a2e025201b235ed7f0cd6c5b6324 |
|
BLAKE2b-256 | 55acf4aa8b04644b14d9f619269d1ff57c0dc848e8aa958b6dd8883ea35d52f9 |
Close
Hashes for kgdata-6.3.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 020d85b2ad3045cc5c80fca10ef2fc159ed5bcfb5cb671b0fee28e81f7c2d299 |
|
MD5 | ce853b74a735cf5993460923164b850a |
|
BLAKE2b-256 | 16bfcaa044ae8329ec23f95f4a0d65f28c5ca50301f3a0da79a7c669544ecfae |
Close
Hashes for kgdata-6.3.1-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 667b6f16cf71c3b37cecd54da7db641e2c89afe41333a2dc1fa5738ce465c1d0 |
|
MD5 | 51ae717dcb9a0c225d0ae4f07eef762d |
|
BLAKE2b-256 | bc087d1b7d07d0d09e7e32b2856d2ac7a682e702130057ee0e5de4b097e6f5c7 |
Close
Hashes for kgdata-6.3.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6917555021e6ded8f28b0af4fc6ba3e840135982ca71b070f860f6317af5d784 |
|
MD5 | f6c63ae66c9fcb39defb42a431e6a39f |
|
BLAKE2b-256 | 3c53251f3da674486dd1f19f4a5d7a643a85b6dac03f65fa81a0e13c457f3731 |
Close
Hashes for kgdata-6.3.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ec375dc14c107f2a2334bae82087fa6ed1df0def2b44ec0b95bea1a827bcf3e |
|
MD5 | 8672645e9e9855378d7d5c50df518e25 |
|
BLAKE2b-256 | 0f12593fb15bbdec922782f116ba87f72b2cda281e0a481159e1e2f1ff90d505 |
Close
Hashes for kgdata-6.3.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a443069dd53d261228ccee8ae0332eb7321dc0170157b46d0d0d510b342d21ac |
|
MD5 | 80f3cf5993be273d24821a2dd63880f4 |
|
BLAKE2b-256 | f6732be93cd737f533f04dacd7b4373e0804c926589174c8ed252fa813245251 |
Close
Hashes for kgdata-6.3.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d50224d46fc6fdce5470131a23bec46ff93da039fd9b102ca416695ea2f97686 |
|
MD5 | a2dc465f341ecefbdb910b0899bbb983 |
|
BLAKE2b-256 | 0d0b24edb5dce13d1b0109c9f154cf6094c7c23c39b3cc43f21bd79608a00d87 |
Close
Hashes for kgdata-6.3.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 89ae579a93ee048e7b33391541ebf99ef736dfdb197bc4834f9e1fab044ae400 |
|
MD5 | 9ce14b5ee764a4cf023724b397dc5931 |
|
BLAKE2b-256 | 1506b6074764428a907549efc76a6525e8a1a29ec5ff621c349e86a58d519ff3 |
Close
Hashes for kgdata-6.3.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2fe2cf8c83967db6c0e39d5f258079d3c6d6e6f964888fd6c4a8b34bb868e0ae |
|
MD5 | 21722bedad34e1aa353c0a36eaf199f5 |
|
BLAKE2b-256 | 37fd95e239269ce5545d727b01f998a7b34ac778cfad44a9e594b65aca7d8116 |
Close
Hashes for kgdata-6.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21dd8b253fd82b82c8f5062f7a09fdac93e5760c30625e991d36299227fb095f |
|
MD5 | 55bb996a85965f46036aebd5a5e70594 |
|
BLAKE2b-256 | a9bedaf89cc0fd1d08a8c4e554dc649881fcf152b7806a5a159fa8d5332ffe08 |
Close
Hashes for kgdata-6.3.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ba19feb9492808318e086b13b36a1f6cb5525fbd40d25965690f22896694646 |
|
MD5 | 76fdf6406b76ee3c675d3d96d07f2b13 |
|
BLAKE2b-256 | 9600c436e59f4f7273c4dd74675b965cd173dc411797f8d7fcd795d1a85aa6d1 |
Close
Hashes for kgdata-6.3.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 58fb7dd6f2778ddc32dfdb84f5543b30232b940fde4859142beebb6e78103743 |
|
MD5 | 235ab68c48a399e347a0073c22ee9452 |
|
BLAKE2b-256 | f06fe02b4f74dbe376164868dbfe851001da924c4370c36e79da27a81365d498 |
Close
Hashes for kgdata-6.3.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48a5236542897689c3299d41948f0c4bede6b687f17532c70dcfc83efba4f730 |
|
MD5 | 8e620397df40ec8072683e3da78b8f80 |
|
BLAKE2b-256 | e1214b02c528d491d4c70ace5b334ccc2b85509f32acb33172ed6dfd83e87118 |
Close
Hashes for kgdata-6.3.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 91c93894872e3d586d54aacbf8edfd8e8c75aeafda4558c3164701b3c5332dd6 |
|
MD5 | 99fc3ee67132a8490044c5730fd27d00 |
|
BLAKE2b-256 | ec88c8b4637cf32cc04cb54c8228f7d9c0102bd11c162448662e67cad16a4382 |
Close
Hashes for kgdata-6.3.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d4571151839eaedf995b8189ff428473b22d2006fe3af906b323fbcbdb627eb |
|
MD5 | bf5e5de8d7d3e0f179d578054091b018 |
|
BLAKE2b-256 | 9d9aa260a125f088e650d58de3c04f19a9f88850b903baed5de945e18a87b5b5 |