Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.5.2.tar.gz
(144.3 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.5.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f5c976dd4ccf3fb1ee519f8b59d9c02166ba2215c3abc49fa0fcf1ffee0818b4 |
|
MD5 | c51de53f3ecef594910424fb36fe4f74 |
|
BLAKE2b-256 | 30dd7b25b78a1371b7917b123d42f8449d748bc9aa821c3c732ff491fb9aaa33 |
Close
Hashes for kgdata-6.5.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 069acff3d9da48cd3f031fa39f36414d190a1de850dfae0f10a6e1f162798704 |
|
MD5 | c46c885cd0b510efa756ec3dff53fb2b |
|
BLAKE2b-256 | b3ad078b15e08ebdde86ff9e5f53b2a2e89432455b197cab1f4240e045528fba |
Close
Hashes for kgdata-6.5.2-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf82837716cbb53b0ea0c229f7189d905035673e3506a2e56b9631f71210fd08 |
|
MD5 | cd98590397faf6c24a7c3b00b0f6a01c |
|
BLAKE2b-256 | 00797ae5e74639b894ff0f4768ce57c3cf3ecd63c67cd59589b4e4e4afcf28f0 |
Close
Hashes for kgdata-6.5.2-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c6c5b051ed2cfdce24f81e742f3b45d78b55e1a5d0e0265403d38bd11d95cb0c |
|
MD5 | fbe5256f15712c80321a6d4b2d982b57 |
|
BLAKE2b-256 | 5af8b7f709593b1943473bb9d94d1cc48dc1fbf6f76299c60074249bcaf8bf42 |
Close
Hashes for kgdata-6.5.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ae50b1a01ba3b394cf605fb517743a138b34fa7a8a234b6992fd65149ece8d2b |
|
MD5 | af79945a5a3f8945440a24d45dc157ce |
|
BLAKE2b-256 | 417cd38ba7cb7e2d5a744481313f40e767f91b6387c4c81b2b83ab83ffc5b622 |
Close
Hashes for kgdata-6.5.2-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2d7feaff7c5b9af5487b388f201073e35845b79fee5f63049ca61ee103d327ee |
|
MD5 | 4d77e6df22cb01588e697c8f66b89ecb |
|
BLAKE2b-256 | 443cb406af07bbbf9ed5a4418f20331b68c341cadb9ec3f259ceb2b9220ea212 |
Close
Hashes for kgdata-6.5.2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8dfe9c5b75563934b66fe7ff51edff68120640208d4e41fb9da38dfd8c85f00 |
|
MD5 | dc2699f7bbe7b566e2b8c254bcc52f4a |
|
BLAKE2b-256 | 840d5cbf0e19b80e25a649c62882bc6ef5eb760137f2d2e33424cc6021d2a11f |
Close
Hashes for kgdata-6.5.2-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 07ebd7f843f613809bea51315dfe9ec59df6bac36d2579cf66b3db351a4653cf |
|
MD5 | 783df82d79f9f8982891455c4a178bc0 |
|
BLAKE2b-256 | 2416e09aded07e8a9a5c5f6b18374120fe13754d5c5d9ae034a90fa83d379e79 |
Close
Hashes for kgdata-6.5.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cad3288afc56be40223225f7f3c777309f87993fc2dc5bf6264312438670670d |
|
MD5 | 14e0abdb02d7a044049cbc99dae116f9 |
|
BLAKE2b-256 | 1a4c8bc4ce60e4a3fdbfb37141ffcfff9f57ac9d7c9530cc7507cdd321d52cba |
Close
Hashes for kgdata-6.5.2-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a1394838dc801ac6d073e5f54e0d2a1555bf24e307220ea40e29388d1ac31319 |
|
MD5 | 60f64bc1a32f4fc6c419746c6c261b6c |
|
BLAKE2b-256 | 7e5eed107d56918160200d8a72b4b1b8cc32f9870c05ec3c5139e8589f490935 |
Close
Hashes for kgdata-6.5.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e6a20337eb9cd9fad48d66e74fe8137aee2a3c8ee245c92841fb4e40522e679 |
|
MD5 | e6c2a12245e43dd94107a420bae7378f |
|
BLAKE2b-256 | d1cc92f5a314b2cf883337924bbcad73587be4373f19312348004c328cb0c122 |
Close
Hashes for kgdata-6.5.2-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 65bb9c0b0b783d182a474b6afbd6a37ec10fcfb2e0ed97d9287bd7261848b1e8 |
|
MD5 | 0dc862f9bd121db11dfe244c458be472 |
|
BLAKE2b-256 | 1aa6949f34f61d48c5ddc7ddc95ccbde8dfc488f8c520d28eb7e1869801b578e |
Close
Hashes for kgdata-6.5.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26356497a6d519752892a003d1449c5de589df3bed8b75de1045151eecd0c667 |
|
MD5 | 5fea0e2ab9832295d47a9bc62f717037 |
|
BLAKE2b-256 | 033d4c3f453efafd3722e9b6ab365f5cfd9e3bada1e04f88555323ad42e003e8 |
Close
Hashes for kgdata-6.5.2-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | beca07f410743c126ea2af6be85f5bd109c54d49901bb34c7d69a64b0f24d30a |
|
MD5 | 9fb683f602abbb1033132df988bca759 |
|
BLAKE2b-256 | 2803b399865127f986d1c85b35811ec49c246aa61dbc70e9b9f846c78762cb25 |
Close
Hashes for kgdata-6.5.2-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a796591d139dd6c8941481655e7d0f3ee9cf821f4aaf4d8447d748b145bd04fd |
|
MD5 | d3d9a9981b318f32c22f07c6de23ff8f |
|
BLAKE2b-256 | f217588e041692fc204940f545a1e2f079df82b27a76bc08f8411b66c1d07851 |
Close
Hashes for kgdata-6.5.2-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 031c45b2498b4d8884db8f454d695aa46e2cb786138a1e3778c2d8cf6ff0d8c5 |
|
MD5 | 6450c3ad9b1c78efb097bcb8063a760e |
|
BLAKE2b-256 | fbcd23651ed928b149c955fbed479dc9e78045456dcc13abb52ab59cd2655c4f |
Close
Hashes for kgdata-6.5.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e94745a3afe496be7bc7351ab8d669c5138f99d81c84e28bf4bccba251fcf37 |
|
MD5 | c6e095876feaf2ed299312e0e9ad45f4 |
|
BLAKE2b-256 | 2927b6937c5d24c668828b8a542aad5f9207da21888247eb2840a376eae5ad65 |
Close
Hashes for kgdata-6.5.2-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6526e7b5f052fd4d8b824336069bb1c3d23fa31d4de1610b17abe974ecafcf51 |
|
MD5 | 717ddd93ef9674f6764d2847af3af435 |
|
BLAKE2b-256 | 6a2b12a639a89dcf44d634d62b0e09d0a85d1ba86099a32979f8cd690b66a71b |