Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-7.0.2.tar.gz
(150.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-7.0.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e1b8ad23966455e541e11cd651fe388b0e057b0c62c375ccb9c77dfa18c4adf6 |
|
MD5 | 6ce9199c8b21393cb46a769810f3bc14 |
|
BLAKE2b-256 | f585d5dadfa830c9be4230ae0a6b9640e9653ff2c183ac36b06921c367740319 |
Close
Hashes for kgdata-7.0.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cf3c62727bcdb53be2357389a93adc5f79531bbcaf2f3d227487a3af2313049b |
|
MD5 | da49e030a8e6f8ae115d60a896984cde |
|
BLAKE2b-256 | ffdebf3dbb271a5fe70b061f9ab710822d33d97480f30414036dc42dd9433300 |
Close
Hashes for kgdata-7.0.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3d9dc783e8787d6789ad79cc8cfb85d680fab740db9de68afb8313a71dcf7df2 |
|
MD5 | 9147043648c856e86a6dec6e62b2c28c |
|
BLAKE2b-256 | 1f127db89ec8ae592e6c002435255661160c472381f92702c2ec45253606a280 |
Close
Hashes for kgdata-7.0.2-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e56ebcc927c34fc6c7fb13afed712901dc64a194642578d67f02b197324757f9 |
|
MD5 | 1a02631689b91229bcb4870d495ceb79 |
|
BLAKE2b-256 | 057174ddb9868d5255718ff1eef1e18ad55b6ef3156802bffd6bea18a791ca2b |
Close
Hashes for kgdata-7.0.2-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4893c2ade8dcd3adc54da53755b6f515843418df43542a628c50453cc593efb1 |
|
MD5 | f51e9b0d83e4dd86c6d95d53b668a2b6 |
|
BLAKE2b-256 | a89793a7b7f2718629317df978718c9431f2cfb28608b41b1b623b18bb4c013d |
Close
Hashes for kgdata-7.0.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b512898f2596678904ea43cc01ebb0223fa2bbd034fc5f87f5bf13ae86791e16 |
|
MD5 | 42900d0082ea69e7fc0a04f42a5c1cb6 |
|
BLAKE2b-256 | dc6fe58ac99b783d0d759fc3273fa42c0430809d59c6aec18b562d740348f4d9 |
Close
Hashes for kgdata-7.0.2-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2ec1bce5d535a79e4c350be280d930fb34a9d0867c47cb9d68d6894a3bfc0e55 |
|
MD5 | 1b223e40cf4f155e6552768810ac0dac |
|
BLAKE2b-256 | 55ad1305035d1131fcf3fd6a4a4292d2417c1f7fdf547f4853fe239748e2699e |
Close
Hashes for kgdata-7.0.2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 34baea850f605b569cc5d1993242da48936307ec4d97861278466a666dafcddc |
|
MD5 | 31bfb700feb76f11709854fa5183fa36 |
|
BLAKE2b-256 | b6f99a8f9107a6623dc496a376d693262b3ca561e489eff6ecc68a610d80e3a7 |
Close
Hashes for kgdata-7.0.2-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 573a73566b69a37ff1d4d767c9c42c38cb7f38ef4f4cc8ef97c0ccedcabc28f6 |
|
MD5 | 38763a705ed1f8fa3b64ad3946371d70 |
|
BLAKE2b-256 | 42fe7fd1a358d6d7afdd1a927bd3d53bcda2e3108e8a0cf190c1c79713554002 |
Close
Hashes for kgdata-7.0.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bbe42cded1858f36bde9156c201fceef80fca145aa380b1fdb6bb1143926f8a |
|
MD5 | 2c79be68c6548602b1cc14af34a465c7 |
|
BLAKE2b-256 | cf01f26c18849c47aa92ee938eab20d79f0cbe3076ec08a4fabf33aec842e94b |
Close
Hashes for kgdata-7.0.2-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93d60b71f673f410c4d4b54047265ec5bef10132856b76d8a9c6769abe23de97 |
|
MD5 | 184ada5b089af14c5345e47489bf193c |
|
BLAKE2b-256 | 2a7bafb31ec03ce15d1093020efa13f8b32b717a43f97a7e5848b010e78d8dd5 |
Close
Hashes for kgdata-7.0.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 34218b73408b32a9aeeb09a892889fd2a86e18e7615701b98cb84b61b702077f |
|
MD5 | 0df95b53e2be9b4adc7e01b8e1bdd5bd |
|
BLAKE2b-256 | 4567acafa99daba3fafbbfb4747be29f5c8040742be17f07d4bbadc4209f5dba |
Close
Hashes for kgdata-7.0.2-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 925189c08e47c0cd8c42df16159a8bb0e1cde3ea62f9fca8ad67556e9252a503 |
|
MD5 | 45ea7d0e7f97dfdf8573ce74b4fbe2fa |
|
BLAKE2b-256 | b259534136767cd5d7cb9f2c52c3f281e13e07355037ca1d695904a913a07af5 |
Close
Hashes for kgdata-7.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 626bc8ec9b89747321b0ae8724a2b3227228b03e9728e4748e49e5478cffffc3 |
|
MD5 | 1d2cb6910373686deeff89dc67293dd0 |
|
BLAKE2b-256 | 8e3056ca49d58cf2743fff02fb08538d87787d6d92d9aeafe0845f60c8cd70c4 |
Close
Hashes for kgdata-7.0.2-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 53bdc145376b10d83962a29d870a712f894835f6d8e514dada122ad50daf79b2 |
|
MD5 | 5682e03b61abadbf218780f68718836d |
|
BLAKE2b-256 | 08e907afa1385bd45f149ec2f96d819603f2509a71adad53585b32ed665fd51d |
Close
Hashes for kgdata-7.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7cd32e258baad3111143c0fbe445cc6845386376aa49a3ad507c53973cb1253 |
|
MD5 | 99a4d7f532b73e6b4bee1445c01fb0e2 |
|
BLAKE2b-256 | 8b6ef12369b2ebf6a6dbf70cc024d8203517bad7aaa5490016de92b5919ee7bc |