Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.5.tar.gz
(132.7 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.5-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c5f9e12f4aa2d236845209918d920133565d05f2516c7d60a6fdb4da25142f7e |
|
MD5 | 102880488b6dbb1e0af73f79e761540e |
|
BLAKE2b-256 | eba9172ca77065876ad9be6002816929271dd3671806ebc0c0df8539657add79 |
Close
Hashes for kgdata-5.3.5-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42633c4ab796a38d0bfd1d64dc5d0ecb42b24d37ea1598afb56f2ad83995b19b |
|
MD5 | 01343717baca37e204a3663491d5a83c |
|
BLAKE2b-256 | 206a71dab986ff76af0d23768fac884cc550713098a2ddbebe5a959bee8d83ae |
Close
Hashes for kgdata-5.3.5-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f50b6cd65eccf88120e2d3e87176cfa19aadb0d385a21af25c814375e3b9e92 |
|
MD5 | ee9d23b61526b8b22253f4e99f7a9cbb |
|
BLAKE2b-256 | 0e89c5ef6870d6813344749802d69127eeccb0ba4b6d6171b39ee8aa8304a5e3 |
Close
Hashes for kgdata-5.3.5-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72cb4197caddcecfdc9b04b01503f3eb420a9024c8b23a4b04b48cf5271e7997 |
|
MD5 | 0a488e82bb07d471efa70c273461acf3 |
|
BLAKE2b-256 | eb63306aa95bc41fe265540b8d76e3b9ac194cf717f63602bada01216225f651 |
Close
Hashes for kgdata-5.3.5-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c80319684c795be5c522c24f7a0ceca8d89fc2b5c66b8ab36d6473a277f20cfc |
|
MD5 | c027b6ad27d80f03d28588d8ca9dcfb6 |
|
BLAKE2b-256 | 354a4ebb6addd3fc0db05a7e31d6fc458365ea5857581a726dfb21dfa5c65dea |
Close
Hashes for kgdata-5.3.5-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e724d177ff0d00c87ff86b2e927af123710de54815884d53e6b5e08e4aef7d2d |
|
MD5 | 389acb36df4bf55e0c61d545fa745f12 |
|
BLAKE2b-256 | 0c0706a8144f64f34e2e9a727af077ffb0114d5a11d5b7d624395c7fa4becb57 |
Close
Hashes for kgdata-5.3.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbeff22a1c8236f1701ecb2b2fe7cef264d1a16eec7e3237a9f68058f6efd9ca |
|
MD5 | 4fc68ce8479f2fef4eb6d7ce36a74f16 |
|
BLAKE2b-256 | ea038c70fcc43ca465d641c47dbb6b4ecfeb978107e273b67b7a389b4af4145e |
Close
Hashes for kgdata-5.3.5-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 851a2600ee9761ef6a38b6e6b22a05e88de67bde46805e0b2544ba9227197d04 |
|
MD5 | e985727b90ded55e065132a5a8cb1f4c |
|
BLAKE2b-256 | 0c383bf913cfa0a2a42e430eb0cbb8811e09d741cb9752eebf19f6243349b0d6 |
Close
Hashes for kgdata-5.3.5-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 15c6680696241bc16672f880da4156973ef8e6257ad51dbeca89ce09dc7be733 |
|
MD5 | 4b1dae8cc01bb38fd58f6cb3bd552f6b |
|
BLAKE2b-256 | 5d13a4c342769a9e1bf09e2a63a90ae8446723dd6e204ed227c2b66e73ff2349 |
Close
Hashes for kgdata-5.3.5-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d9adbb615d3b06b96e9ede5a5969afb9b3f7d84e60fc6c042980521d753d6b70 |
|
MD5 | c1bdd3b9953fbae70dcd360f722a9858 |
|
BLAKE2b-256 | de27e7639faf69f0744f0776d69330508dea2212c473f79020e7e8a463f76594 |
Close
Hashes for kgdata-5.3.5-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 60fb53727735eaf4f83562abcba8fe655813da8dba4f4e6ac5074c47868c0a0f |
|
MD5 | ed24a9ec4e3c2b70990ba0c9f32c9f0f |
|
BLAKE2b-256 | 5376b4a2f2b663b61de815c2b15bda0d8766e1e4f570a9c0c87c191659be60fe |
Close
Hashes for kgdata-5.3.5-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bcf4ff3862c51df12a510d09bd77fd1d255995fe8e2761b8dbdc9037c7baf1f3 |
|
MD5 | b3c6624831afde9031db221f7f027939 |
|
BLAKE2b-256 | 4115b9c767139f8c79cffd8f182117d96d82becad1468846171353e5f42647ba |
Close
Hashes for kgdata-5.3.5-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 574de28a1b8a6bedd9868b7460f982ea3707a474f7e2bba02346e6ec86b3126c |
|
MD5 | b872205d06db2879975de1018219726f |
|
BLAKE2b-256 | b212ef47fe15b96e6843f2a19e6872345c322687366dbaeda44de7bf5af58cd0 |
Close
Hashes for kgdata-5.3.5-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c78e63b2fda6cefc8c9c7ecca9a620c7b0c5e30775b02d233652c32372dcc0a7 |
|
MD5 | 48ecb9f7587e37e9be6b5966d7bad769 |
|
BLAKE2b-256 | 486fb333b91da1bb2b3b1d40bee76cbef451e6d0ef3ff224d5e0732ed52c77af |
Close
Hashes for kgdata-5.3.5-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 96d3b6d2a999470087ac93603067a02574989bde0b0b2f626be40db8714d1ece |
|
MD5 | 51f6d1124ed338d7e3145e8b8660aebd |
|
BLAKE2b-256 | 57b6da5e00cd7906ad33ec5de01ed248525dc75ab8fb16e75ede9f483e85d24d |
Close
Hashes for kgdata-5.3.5-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 45134f94fb1c66425023bcfa8d7aa2a7cafad5f0066e02acc931decc839a81cd |
|
MD5 | 907ab28a3061ce4fcb2fd3408e106b43 |
|
BLAKE2b-256 | 6928e547cfb9f2ecf733740ea61a75de00f1253c77c188f2d63f12cdfd026a82 |
Close
Hashes for kgdata-5.3.5-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 789ca34dc86a89b73f1d07c3bd6ff5f64d96e486831d3390fc94d4e620920728 |
|
MD5 | da2388c43fa4741c5ed1f947b0e0d4de |
|
BLAKE2b-256 | 4edc1cc5398688b59e6c7bcab39ebe54e8005022d4b7e49d5d0571b857658f29 |
Close
Hashes for kgdata-5.3.5-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed8f170b26d34b60287206c13839a4808e01863eb3ea3223378b525184987fe7 |
|
MD5 | 0382b19b48d6124025cf92846b2cb38b |
|
BLAKE2b-256 | 805aa8b2426da502ded5de85f7a87c51e631ee0e1034fdae7b2a5ce491b50b2f |
Close
Hashes for kgdata-5.3.5-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84e56703a4d1af380b9b339d71da2ca7498f563abe3f27a738b877cad4182315 |
|
MD5 | a73c8aad06349bb47c8dd3bae570cab1 |
|
BLAKE2b-256 | fd6331da67a0fabea3f029e8a343c7f4fd61d276d71ab8260bf0a7dc0156145b |
Close
Hashes for kgdata-5.3.5-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 491b34d061845d85b446273ac4aaa7e923252c709bdcd307075a97803f1cbdc8 |
|
MD5 | be13d8471ec5bbe9b08cd465149be7bb |
|
BLAKE2b-256 | ec10481fdc07e6b230c184929416d823e648e36e45360798b5463b0b655cc6ee |