Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.1.2.tar.gz
(115.7 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.1.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d4e11a85dae1015776abc675eb140e95e4de4213c4c640f19f9bd5696f3632f6 |
|
MD5 | a34c69b6473ff7c7697564d522c6e750 |
|
BLAKE2b-256 | b9db53d22c788fce1d18f25c5f1684a6078b2afb0d0444f2e5a822c4ce0d54bd |
Close
Hashes for kgdata-4.1.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77773177ebf0ecc7cac2d664daf06b80c42b0187bc659e99dc6267d546a5b4e2 |
|
MD5 | 1719a1f0f0ea469300d99c72ebb5125f |
|
BLAKE2b-256 | 09dd01523ee6cf5978f8ef7ddb3b63c9ebce8559d462a96b822f36d888668ae8 |
Close
Hashes for kgdata-4.1.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 98ed8257af87e08be16fd72c983ea362b9724df2e127334c1dee380de2a20b1e |
|
MD5 | 5faad49339c12e15289edb86c9e5f122 |
|
BLAKE2b-256 | 49388eceb40fd8717c3937e95b1e997b43e54d3902986485eba8b42b6601dbd4 |
Close
Hashes for kgdata-4.1.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa3010e793730f3fc9fc7728991e6530857e187dc9e579ecb67423510d860804 |
|
MD5 | 372b727bea6251f85dd0675fb135f3c7 |
|
BLAKE2b-256 | 65a1d3baeac821f0383b246e54dfba8f21f3effb6ecf86beee676d56b0c99bf5 |
Close
Hashes for kgdata-4.1.2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3a2b3347ccccb2673664883a43442dad02b11568819c9da260464f25a5cf5397 |
|
MD5 | 111f05342679a3fc1885560586796fac |
|
BLAKE2b-256 | 85fa591e4687e8a9dfb4c04de8bb0eac7a6bc334d57c0f223bd41cc7d52bfbda |
Close
Hashes for kgdata-4.1.2-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f63f73e208d2caba6e6c770d0a37c2074b6f8371425b9492fd5b6d791e886064 |
|
MD5 | 5cd4840abd33374bfb014981cd2509f9 |
|
BLAKE2b-256 | 025134326057caafae8294bfb927e136256c4178fe173dd3e6e09c2c320996ce |
Close
Hashes for kgdata-4.1.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3725c80e515c947cf76cc81fa3aca777776f2b0a49183f6fdee2389cb2ec4bf1 |
|
MD5 | 87041cf851d4140c2640760a79ceea52 |
|
BLAKE2b-256 | e78d3304db02c855a17f3a5b7b6107aff4ac14cd862b7b844729bf945629b0fd |
Close
Hashes for kgdata-4.1.2-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2b75ea271853178fbdf3efa06074a34e346cff320186fa2b25c7daa6e6747a9b |
|
MD5 | 1946d2608664a34f0e5bdc17eb876d89 |
|
BLAKE2b-256 | 1dea08a01a8b3a789151c42106555bd9dcecf8858aa7e605b342a95123f53dc9 |
Close
Hashes for kgdata-4.1.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b9037b8a502fe7bc88ec63ef1d5ee88b45f9c32bb6fee821db00bfb4e98c7758 |
|
MD5 | c73c12aec45a6cc58debb97c681dc5d3 |
|
BLAKE2b-256 | 7771994be0f55a554de28e3512fd3c29105b8baf4646069d542a6866b766f6f7 |
Close
Hashes for kgdata-4.1.2-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a0d518c6828adc96b506a251bbba192f9b6f991872a485517a97bf2d1ab5122 |
|
MD5 | 40fddee1c9a45eda0d9d0f5d0001a577 |
|
BLAKE2b-256 | a9b190e7c1fd9966cfc6c211c24f195b60b7c726344fb9e4fe2d0e91ecef185c |
Close
Hashes for kgdata-4.1.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3b0c4b766eeac07549ef303a390b95175be4e33e4ec495b84f1f70d9935245c5 |
|
MD5 | 5c9c3279a4a7220c256376d170b68e88 |
|
BLAKE2b-256 | cd8116be3312319723d5e563d9b3935af1cf3ab527afa766be986e4068541ac7 |
Close
Hashes for kgdata-4.1.2-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ffd6f3835551c8f7af306c97ceb5fbf24d667be3ca479147b99ce39e83ced3cb |
|
MD5 | 7995ca5ef07dff9c5ee70f493d680afe |
|
BLAKE2b-256 | 8f844995b9b8c6e8221de551c9412800833c2e98a737d142ca6dea8466a80564 |
Close
Hashes for kgdata-4.1.2-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a5a4343a5d3f03b2bfa5bacf8759c6bd357f3ef8be7ad31cfbfa861ff2724b9 |
|
MD5 | 851d25da01ee537aa47b0208533c9ecb |
|
BLAKE2b-256 | fe4d6d2b9e326ea6088c0d21d49c526cf43935f50b5b7cdc7ac30da1d3c65243 |
Close
Hashes for kgdata-4.1.2-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc2a4bcb577c7f5e819bd889948f66bccc9742c73c464dc74386f697cd401276 |
|
MD5 | 43cbf7afeaf1e7c5f88fc8b6cab6d20d |
|
BLAKE2b-256 | f96c17492232ce592f36704556a2a38bb273842653a0ed32a9c1a9f4f6195e3c |
Close
Hashes for kgdata-4.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 99f15b7d32bcc89cdebbe2003b0dd0ee34af96566368d9eae1eb79566b003002 |
|
MD5 | a4671fb93f31bf3c8490520289ab804b |
|
BLAKE2b-256 | 8fe5138dea1af2d4a322d59802a9f998993fcbc67ef5cff1d61aaf55b9446b27 |
Close
Hashes for kgdata-4.1.2-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3851ba2561723162b10c33bbeeb33c078b8f2200cdd3f5476e4a837aba34d26f |
|
MD5 | cd0fae5370286d91edf385af13814c84 |
|
BLAKE2b-256 | 789d893215585bfebfb3a2fe968a5583c909084e5ddf611b9fb6150875d54289 |
Close
Hashes for kgdata-4.1.2-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8b7f825c97c77f1825df506e249080320ddd45845223744c3f0ca155c85ee8e |
|
MD5 | aa0dd1ce0337b1fcd5e466b7123be337 |
|
BLAKE2b-256 | 04a33ac704f66fb44271125e648ab3d08966d02b6af9b6467c66600c67fa57cd |
Close
Hashes for kgdata-4.1.2-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 24be2cded41b714932b1ad90a3788e6ae4eb27fcbef4472364b4f4bf95155e8e |
|
MD5 | 6e805c86ab7b317bf3dd740f879bf390 |
|
BLAKE2b-256 | 51b152537ea310525a0fcbe3846165e409abe0f4ebaea4a349c3bf960ee9554e |
Close
Hashes for kgdata-4.1.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbbfc7f84e5a1d23ae1fca1cf9adce7178bd00262608a50f06c8c7228aa8e4e9 |
|
MD5 | e8465d2b5e4dfcdde2ced9d440b985fc |
|
BLAKE2b-256 | 7a559780e2c67970e13f693511025ee8bfd3858bb88d8ac52f41cbff9a18916d |
Close
Hashes for kgdata-4.1.2-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f036b253aa6f92021ea134f6f8d393e6a4ea92f19da89c62214496e1c63fe50 |
|
MD5 | dced9d4180f3fe486d7967539dcc517a |
|
BLAKE2b-256 | 93fe7facc5c47d57d717585407c5b45726460ae4e6ba982698fe255dd6f1fc51 |