Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.5.0.tar.gz
(144.5 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.5.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad33b8ca429583f0376430039f26229bef2a5167579cd29de8e9953d29423c55 |
|
MD5 | ebe1d428526d3d13610ce6d5973ec499 |
|
BLAKE2b-256 | 932a4c38f606a3e7662eacac40b7ec1eb2f7d42ecbb5eed5228630c3ee0a9f6d |
Close
Hashes for kgdata-6.5.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8221dd76cfee9a56d3c1c47ec8c8cc8c008fffde814e1cc00cdc67070fa41ac2 |
|
MD5 | eae06df919a52d87ab0b926224679b42 |
|
BLAKE2b-256 | feaa5843e2f7cd8744a2b8cd61a5644b6088bd3e30567ab99cac231f6400594c |
Close
Hashes for kgdata-6.5.0-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea6f1850bf569f2b04ee37701ff95ed5a7c77c073807dc5a4f48150918cf0d0d |
|
MD5 | 36ba7e22ec1e92aa697df6f0f098c904 |
|
BLAKE2b-256 | ece853cf87cd6c216390d4a74b7216445090edcc7f03aa62afe944c2502b1e1a |
Close
Hashes for kgdata-6.5.0-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9a4e8e138f9695b957c79c2d59c2991f6fba546c739dc06d795ef38f7a3a670 |
|
MD5 | 30352153a505159c271189cbdb48f38a |
|
BLAKE2b-256 | 99088d857585fe3e94fb7203a8bf2e3780ad314fb503534e9be2ddb3150658f7 |
Close
Hashes for kgdata-6.5.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e790da434c160400e3e1b052afdd442a5c6262178ae0b3ccb43e50fb7ab350f5 |
|
MD5 | 152ae7fcd4cfc125d8fda7a825e6d573 |
|
BLAKE2b-256 | 7d71de5b66e55abda78572252e99730593d036ec06e8d9b17fda2f6c216054a8 |
Close
Hashes for kgdata-6.5.0-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 50d75a94d5dbfc5ff69ed659a55c1a30b9574825ded895e3ad27ada9e4bf2570 |
|
MD5 | 28cbe12213891bacf73885667afc27af |
|
BLAKE2b-256 | e619fe284c2667670ec61f42b105acf9e16d86974a7cf4b146478bcec7283fff |
Close
Hashes for kgdata-6.5.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4106dbcb1332261b736237997384ba5b7e45c81aed058a7797710dafc8d1295e |
|
MD5 | 3e3f02c4a5646c7298acfaa29be9ae77 |
|
BLAKE2b-256 | 2855b7fefd687ac9cc18dd3ff365fe48466ff4970f028ff0ee4705f895a7886a |
Close
Hashes for kgdata-6.5.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 164d3501b43c0a9ce7efd20faa193dfc4c3829fa4aae8f19957404c92dbb6520 |
|
MD5 | 3eef57feb4f1710cf464eaadeb11b4ce |
|
BLAKE2b-256 | efec8e207d118be890fde6d187d0b006bd1f54cb3c6633dcd926af4ea85dcccf |
Close
Hashes for kgdata-6.5.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7965bf8999b6c0e30a057f319b041a7b1df546179c766195f70eb2c0fc399e93 |
|
MD5 | c5a2bfc0a639e1905c26a0471ce07be2 |
|
BLAKE2b-256 | be25294cff2e6f24c8ee9d0ac391c1c005efa1042125a7b232a15b065bb43e6d |
Close
Hashes for kgdata-6.5.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c58ed43a061531845aded00bc76c8cdb62bf2e8ee4f20de32103be17d859d40 |
|
MD5 | fa77da52324a80eb5e4257edc0f7f236 |
|
BLAKE2b-256 | 8c15278aa97b498671a05c4737050bd472975c8b880e993c3278a41dc6c7d06c |
Close
Hashes for kgdata-6.5.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd2df70003b4bf5adc664a88c230b9758ae9425a444308f42137666275a8c9c9 |
|
MD5 | 2de9533002ce24ba8a828003edc4875b |
|
BLAKE2b-256 | 8e1b0dcdf737c61b78d9321ac8f21bf08dfb26ea37bec6562a1d970507a08fe3 |
Close
Hashes for kgdata-6.5.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea119df1d7ae2ada3daee06bd2f3ee123017731d91112331b1fac75c6a89f8c7 |
|
MD5 | 74983a7700bdaaba6ab4a6904012f3e3 |
|
BLAKE2b-256 | 980caf1ccf298b36a2977dc3db2aa12810d1304245626f1ba10af81f98eb773b |
Close
Hashes for kgdata-6.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7980f726e68371f55aa6f7376bb62c1725ef727893ebd929e6e56d1cd792cbb4 |
|
MD5 | 6c347bc5650b0eab327c8487f42e78ca |
|
BLAKE2b-256 | d7b52408da69d1ee6cb8a8da6154460d55484648c6b3fc335afbceebd4fda2e7 |
Close
Hashes for kgdata-6.5.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a21e5771fbb100a7ca2248070ab73acfaea070dbccac15e3e542c7101f86976 |
|
MD5 | 5d4cce8a80e72d30575e69922b92020b |
|
BLAKE2b-256 | 0cd6d97d4a621108f0cfb4803f55f84fead0dd537bc3862a5f4c15b5f5c56748 |
Close
Hashes for kgdata-6.5.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1efcbd378833076484249d3bd6e99adf66fe2c77f6a2ab98ba65971c42828f48 |
|
MD5 | d3e5a150a9273678112b0f111390ffc8 |
|
BLAKE2b-256 | c2be5373f39ce4cfc6c937797b496cb231003e3e8269b5177126001bc2e31219 |
Close
Hashes for kgdata-6.5.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44a4f7e5bef0557e3eb33bfd54d50b49ac473643a2c1cf18ffc2b5119e607f4f |
|
MD5 | e3806f87af8b7fa98b346c1994318dc2 |
|
BLAKE2b-256 | 90a87092aa1f640acc2e85bb05d11dcc7a6e3ec3d4c46d0f415b74ee2dbecf2d |
Close
Hashes for kgdata-6.5.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c914e9b8bd6100cfd07ad95b3514441aeb4ec224464ea6c354136d2d8f72fc13 |
|
MD5 | 6a79ea9b0998e07afe2afdaa18ee6dc1 |
|
BLAKE2b-256 | 9265569bced032983ec41f587ec3858658494458b1885a31d3ac9d110d5f2316 |
Close
Hashes for kgdata-6.5.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e26e98ce565c3cafa74962a3a5e4497397d39b9bafa198a81345c1f2a27c4867 |
|
MD5 | f08d4bfb2e163c1aa80ddd3a88ff3fb0 |
|
BLAKE2b-256 | cad5b13de03a4a99382b1738f59e62bc4609a96b920fd6d9a39ae1db8ad92c40 |