Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.3.tar.gz
(132.6 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 723fd438ee706348e50f66a96f6655bf6a3e9ac4fc26d65b1cd273163bd21bb9 |
|
MD5 | 73a80721b3ee418ea690abf9efd54cd7 |
|
BLAKE2b-256 | c285a03e4939ab44f331db7531af335b6b3717f4067cd2df73fdc29ea3c65220 |
Close
Hashes for kgdata-5.3.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ffb01fec5646484f6a7dc56993e204fa0a838bee4d9e41aca69249429477757d |
|
MD5 | d930eca203b50ed87f88b3521d27e90c |
|
BLAKE2b-256 | aa17c16cfed1a3556c4465704221a2117c3ede8cd5b81365e8ccb40127627774 |
Close
Hashes for kgdata-5.3.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c38d5fad85c3cc824c6a50d53a766c38b64477eadb71473e16c0af3a786ff926 |
|
MD5 | f84acf296efecef7d94f269b1d4c0d65 |
|
BLAKE2b-256 | 2dc6deed2b2bcc6b082425f8102722db917c9fae607bfcd33a78374325b2cc0f |
Close
Hashes for kgdata-5.3.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 193f5e274cf480a0067da0616091f499cf7787ef7328791e424cd9c623ca173b |
|
MD5 | 39109bac22774a797d3e5e6a9c520597 |
|
BLAKE2b-256 | 909861df2ef685db8d2864a1e4d707f0aebc2830d912c5d62b49a9a7f1a51f0e |
Close
Hashes for kgdata-5.3.3-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0fc2f2d00243c10bbb73490f401802d7c2cae885b19d861e5e84fddf5c62a7cf |
|
MD5 | b0289308310945b6f57ad3a68981f489 |
|
BLAKE2b-256 | 2a462affb8d8c2c2cc01105be8a67b0c83915fa41373c7067f56786967355c37 |
Close
Hashes for kgdata-5.3.3-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21bfbb810aea465478fbf452da56b33af81bf1d86e65f8fe17db1304ba30922d |
|
MD5 | b6d472eaca98e21480a3b1083d5f6efb |
|
BLAKE2b-256 | c1440437575a47f262365dc7a4a18498098929de4c9dd5a7072af97dd8505ba5 |
Close
Hashes for kgdata-5.3.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e3c965dece26e8648a7ba6a09d1bee6f36ca58a4a676a5dba59ebb8dc8fd2693 |
|
MD5 | d95bcc073506bc7063b868afba3c86ac |
|
BLAKE2b-256 | 25c7eb590b7ecf0c0433b7258ff77d5d36f26ca26d76314ef96ced9bce508515 |
Close
Hashes for kgdata-5.3.3-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 600494e64af82aca64e08ea3b0d3d0f6967d4aad3b401812fe3241c313b7d15e |
|
MD5 | 7c7a1fbd31c0acd8c2fa93a325bd7706 |
|
BLAKE2b-256 | 13897155265170d3258368f994cc52aba807fb33fa00963f2a1b38d3081e0aeb |
Close
Hashes for kgdata-5.3.3-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 203fedb85f53c1cc2c077af601cfdc272553a36a47d2e41ab0b97bb344354f28 |
|
MD5 | 7189bf0a6549aad4b29c316c679bfa1c |
|
BLAKE2b-256 | 09d68502628b67e7c33f2ffdd91a2460d1d08f93561e368a664ed21dc986e663 |
Close
Hashes for kgdata-5.3.3-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed5b14ae75f9aea1f1b1f1c3c83eacafca279c50073dc84c790250e20c055b35 |
|
MD5 | 5be8882fd3971269a0d69ad85fa30f04 |
|
BLAKE2b-256 | 13ab2bdcde58dd600b2e324aafadaaabdfca6cc9765bf06c79fd8786bd518b07 |
Close
Hashes for kgdata-5.3.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f63991e1c5eb4bc12004299da25ab0d9e24f266b2557174049e08615a678ef6 |
|
MD5 | bf475ea4e395bdc95c9b8cb05e37272d |
|
BLAKE2b-256 | 1be39c738b73390629182a427f129a6e379ea2567ea6069634014d919a23e6ca |
Close
Hashes for kgdata-5.3.3-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ef2e8194da352cf5dfd719267f9c3778a05164c1ec7bdc77ef227c7da6152ef |
|
MD5 | a15f8e79852684ee4dbd8dcb82f42590 |
|
BLAKE2b-256 | 7269f2daf8389deb993a52d7b754c6efeb4b29b7dd70bc11cfef9516caed4537 |
Close
Hashes for kgdata-5.3.3-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 17debf2a90da417d1333368a53d1c847fabec7d66065b753c767e969140b44d1 |
|
MD5 | ce2aa01603f0371aa218aeecafafdf01 |
|
BLAKE2b-256 | ddccdccc02a93d4ba9672b7d0d9d792855ce54de19deb919b0c5e661bdd5b281 |
Close
Hashes for kgdata-5.3.3-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2157c7bd1ebab804627221a8d0a526ebbe6e7ab7678f2477202e975b1544b64b |
|
MD5 | c3a01ff0e94984097089b8e5309a25e2 |
|
BLAKE2b-256 | 31448e0636697839784f7ea33a7652789d7ad71ad366a5e78e6feac81c025312 |
Close
Hashes for kgdata-5.3.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 734ede83c631ed72d3451af8b62f25a7ed0da30639de29d1e4b40a385a5e32b7 |
|
MD5 | 1a4844136a64ac9ba27e762c437be5aa |
|
BLAKE2b-256 | 20200366dd37ebbe8bba6405247279e9d9493dbe7afe354549830d800ada40ed |
Close
Hashes for kgdata-5.3.3-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e91d975c8cb09675f6c83021e498a28342b5234d34ca9c4b7fcb2dc5647bb5c |
|
MD5 | c756288d37b0d821682e0295c3f11590 |
|
BLAKE2b-256 | c7511355efe252ad60dc8548859ffaa2b6d5ea0328c119f0229fb030ec0c88c4 |
Close
Hashes for kgdata-5.3.3-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | adb5bd4dd118ff0eb36832b4ee74afedefee7aaf1bd202244214deeeecb7b3b7 |
|
MD5 | 625ab9c3e980932dd1e017c2d14328c7 |
|
BLAKE2b-256 | 4599bb0a3c02eceecf19f1d81f4d78977c34b6d95eb43e428383405db0f0eb0f |
Close
Hashes for kgdata-5.3.3-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d3bd420e5ec76c295093c95d59f16c2362b061610e86704891d562a0063ff5f7 |
|
MD5 | 9bb28e33d6bce0a928989756479c785f |
|
BLAKE2b-256 | 3c11205632570b523cdd7dc05c7769dad95110ab07e8c25f3575385007318e4b |
Close
Hashes for kgdata-5.3.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6cbe58a237cebab20aa2af4d177d6efb6c8059389d9f9358991b6c843e29cd76 |
|
MD5 | 0f6eda29a53bb712a5e8bfbefebeaf6f |
|
BLAKE2b-256 | fd38f18134a403d6db5ee56e1b85dbcc9913c16f0ac8659ed58ef5beebfd9281 |
Close
Hashes for kgdata-5.3.3-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c4d1a89062bc17b07e690570105f90bcfef05f74aefbf5fb151c3c2726d23ca7 |
|
MD5 | 12ce160b06f1c627baf523df7e1a3493 |
|
BLAKE2b-256 | 6edb47b103f3808614f737558d7dee16a79dae7c851912a78ff17997b03b57af |