Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.0.0.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.0.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e749c969d7b9e116db3d7c9867e63c20594a1af65fcfa2544ca210e95348f84 |
|
MD5 | b7905b7746cecbdeb78d00b4402910f7 |
|
BLAKE2b-256 | afb3d92c5bc4740219565ae22bfec98a34510e50d4165358f5d60805540bd8ee |
Close
Hashes for kgdata-6.0.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9c4fdc5eb00801b6edfac95bf36c4779fba53729e7660484770384ab24f1a7c2 |
|
MD5 | 0df169e8ca04b296bb5916bbf9ae77ea |
|
BLAKE2b-256 | af4fc71050e322e2562ed662a3a5c14945365114925a76f43d3d8d7a69a07aa0 |
Close
Hashes for kgdata-6.0.0-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dcb1f8431609309cccfcefbf535f57edb6396ae6f2ccd64274e017e6b1ed4106 |
|
MD5 | d2d8a45e1f7194e3206a6268af1a626b |
|
BLAKE2b-256 | 418b9f2b7bca06c058148e70a21a67077021f94000cb4d4736c6b46e818c8295 |
Close
Hashes for kgdata-6.0.0-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a356d76b8472383498eb16616764a4024a3ff0a868fbd5e6754d2c961282dfaa |
|
MD5 | 87b4e24c9442566202db632e137462f8 |
|
BLAKE2b-256 | b610241b0ad48104b47fc9bcc86021d837b718fc5ac1bc26b6bfd54e35f9c0dc |
Close
Hashes for kgdata-6.0.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4456c572f31366df5b9e44dbeca4b9b1af052fe9dc8e5c457cd53803e3803a3e |
|
MD5 | e84d6f586ec2b57756b8f027390812f3 |
|
BLAKE2b-256 | 14feb3c4a983ff67ae1ed624450a2523cf57e4167bd146d1113a2498fe873b2d |
Close
Hashes for kgdata-6.0.0-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 11be22830e2c7d0e90ec405c34ca6973993d248fb7a22a66157a11dbfc62708a |
|
MD5 | 8055741ad9bcabd3f2cb3f5a7e834312 |
|
BLAKE2b-256 | 5fc0ddf77e6edf122bca8dc0a38e426da99527d816ce3dde6639dcfb772b046b |
Close
Hashes for kgdata-6.0.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 46500cfb9ffe1844f5192f955f77bee50d3046bba4812c706993572767dc6ec2 |
|
MD5 | 0383cc6f71e1583ac6ba5fea35fdefcc |
|
BLAKE2b-256 | b3c5efde2bb90dfa529a6c68cd0f6da99a280d2420c6889d97d18a3575de2ab9 |
Close
Hashes for kgdata-6.0.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 013791efe5a193176ea77772289142c2c74ab7cb054754bb9a2febf598d62d1b |
|
MD5 | ff7c87a19b4a2c11829a4771fc11f1be |
|
BLAKE2b-256 | aec045f01e5b1ca7b1c950eaf2f8010f94afc4b1283252b0a5c0638a53f29368 |
Close
Hashes for kgdata-6.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 079567bf05886cefd7d760b55aeb94cbc60a2c20e264943fb39a4a628d957ed9 |
|
MD5 | b176fd265a594f5d01714c70e921c216 |
|
BLAKE2b-256 | cb369a13687efaf443c348654d72e8b09a55493a6965b5693764fb2074f95735 |
Close
Hashes for kgdata-6.0.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9af7686a035c69c07e56e1e57d21adb6584ddf21a7fb7dba46350d2b12c16ff |
|
MD5 | 9f6f374cd624f446536fcdf86b5bdac0 |
|
BLAKE2b-256 | 6f617b7238387c68ff265a6bfabbade2efa2dc6b83b926f27c6363fcfd643ac3 |
Close
Hashes for kgdata-6.0.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b05e20a736544b0a91d04e46e0271fbcde9e3f05ef76dc3382e0c33d071759a6 |
|
MD5 | a708c2bfc1c7855bd0e00ca78e898da9 |
|
BLAKE2b-256 | 5219df8c8519889dd41b8cc09521b0bfed554402038cfbd47e43208a98c3f6ea |
Close
Hashes for kgdata-6.0.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4c4f293d41c45afc8b6a0cbbbf2266801668f92a559d05fcaff1ce4799d325d3 |
|
MD5 | c3a57dd6c452c3fd53f9c51327afd747 |
|
BLAKE2b-256 | 3201070c1e3ed987c7507bc8e03b5cfa6a9114e9b0e79ee9e68988a7b05aa5bb |
Close
Hashes for kgdata-6.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7ceebb7a219c42172dec6cfa4bfa677418ff46f75ff7e61479ae92d52642b90b |
|
MD5 | a6c828c3c81ca73be4d4d2c8be5db11d |
|
BLAKE2b-256 | 7775082d101e7423f34cd296e72a601243007076f56ed0f89848b1b66a2668aa |
Close
Hashes for kgdata-6.0.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8826602b05b9c9d58716a25357818d0d50c2d452d9ca1e105ffe583525522dcc |
|
MD5 | 424b3da798cd44d9fced4006ab3faa82 |
|
BLAKE2b-256 | e61161bc0a2f940e73afc0a8e6419538cf0035c40c4b086809c2b4dc60f9edad |
Close
Hashes for kgdata-6.0.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca4fe1f64f7641297c55a60192a4a985b2d0ffa0e0f97ee1b20c54ce17dd19f5 |
|
MD5 | c74e733e427d1e2611ac62d6c2693348 |
|
BLAKE2b-256 | b1d8a9448a55d377368bdb59ef4044f6a8983f7a826541fcdb64f025e8422adb |
Close
Hashes for kgdata-6.0.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbe9cbb1cb4701118f96598f7f054f8b214ef9032a572f27bb65f31177776aa9 |
|
MD5 | 849cc4bad24c356bb2f322cd95563712 |
|
BLAKE2b-256 | efe9dc28e7f99aa53c000811c7280928ced04e1b0d6db52b5c7785f633f03c0d |
Close
Hashes for kgdata-6.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ac16b982aa205f6f8beb7e1a12857c96553d63fda293b6ccfd5811be14d0b935 |
|
MD5 | d5d93cc338b4349808677b158e8554fc |
|
BLAKE2b-256 | 3ee5cc44efd6c3cd4b1a7a979bd9413be84bea5d209880505d225c4f7c4f7dab |
Close
Hashes for kgdata-6.0.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e57aa93bf663759427615c13de6339a159237c8f8b3864833dac3e774920f5e9 |
|
MD5 | a7f0ef57c32342e44f7fec1d153d8931 |
|
BLAKE2b-256 | 1ff070c0a454fd94ea1d205137e966853ef5a272a90ae140020dc184b2045842 |