Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.1.1.tar.gz
(123.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.1.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4745d525f601841f0ba4fcdd415105bca0ddd1348374e2df849c842b0c98bc93 |
|
MD5 | fdc110759bd2e9659c698dd2e6b0ece1 |
|
BLAKE2b-256 | 992b6411e6aa7be4c0f20bfb86503677c3bb4b8acf7b3c03e2ab24fa1a5cad86 |
Close
Hashes for kgdata-5.1.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ddfb0f01fd2ef32e48ba5e43080bffcaaa7864d3149b30968e29a925d1d5edee |
|
MD5 | 61e17ba18146b08307141a68842c98d2 |
|
BLAKE2b-256 | 51fd2b4a0510079b971dac9e740e13d3975b73307624191c7fc4b600fb65cdfe |
Close
Hashes for kgdata-5.1.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9cbc44a79415a04cdcfd5538d8cc77b3587f9af86a3653bbd2942e230a3f6176 |
|
MD5 | c51499cdb6a6a762c072f41e269c8ae7 |
|
BLAKE2b-256 | 33d83e839326b82ad30e73895f4b62e6b6d7e54f1c4ce517fb7e8866aa8046c3 |
Close
Hashes for kgdata-5.1.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eb919263ec32083eb907f842fc7fc6fc27bc2fac6265222aac729130188d3f65 |
|
MD5 | 798146ea969f38688f4b3ad96a8cd6d8 |
|
BLAKE2b-256 | 5ac0b3a7add51894bff76d35fdc11c1a8fcf0dc4027b67db9eefd5f2e942f5f7 |
Close
Hashes for kgdata-5.1.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 53321a9c7a64505684963d4ea33bfa9e74779b2372bdd515b906345fe66d0660 |
|
MD5 | 07f0a8a3803be3d4b2a3e4d534678b5d |
|
BLAKE2b-256 | 9b99ae24cafad0f1da066e38c572e2df51b3baf6e2ef2805bd914070f48f0615 |
Close
Hashes for kgdata-5.1.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e285b673b6b1d296a39f1ac56a63d4dfc8f66ebdcf964dc434fc8c09ec0975d7 |
|
MD5 | 05778a168ae3af373921e4828f088c9a |
|
BLAKE2b-256 | 2e0e5cbb9222c4827500acaef96e29f25abcf8d8cd22ac767681b076f8fdc5b5 |
Close
Hashes for kgdata-5.1.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 87245ec0b570c2fb08171fe0e03d5a8a09780f6a8fcb677e2e7f715bf23fa007 |
|
MD5 | 09e59800c61d945b067d017cb230cde5 |
|
BLAKE2b-256 | daecfb0e76544ed702b2aaede78543d810b8241d0975bafee1793c518f89f22b |
Close
Hashes for kgdata-5.1.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3a8795839275dd8ddb22c51033ac999059203d9114186cf7fcd3d3a23be7e061 |
|
MD5 | 47447c6f719e3a7ad67b888ba35743f1 |
|
BLAKE2b-256 | 589cd9b819bdde00b26192bba932b3ceef09857f7608bc345293ef5b5140d048 |
Close
Hashes for kgdata-5.1.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f52bf61d9a20f7478df22e9605a01652ac76c430e3c65a0f816fdd8c7d9d36f8 |
|
MD5 | 31ca0301d1250f5e53d8a0781411f11e |
|
BLAKE2b-256 | ed8a55009e86d4a296c6dc67904fcb615a11bea946db1343ade9cbf61d5e8cef |
Close
Hashes for kgdata-5.1.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12ba76b9d9e7ca2a3dfedf0d6929c32b57de8ffb47fa4180cbdc5975aa69b698 |
|
MD5 | a698490bd7a4be4773dc548fc72a90cd |
|
BLAKE2b-256 | 85630ef82441690e0ab7c0acc5c53d40c7090639e6bd23521f792dfdf910ac63 |
Close
Hashes for kgdata-5.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84297e4242f7ff705a44145a18efc82d73a2bb2f46f61749f390c5a633e0caac |
|
MD5 | c434fc4dd92231110e1267d352a66535 |
|
BLAKE2b-256 | 54a9e48c579e5c4c76429fa764a59e522e3ee044245387ff8a2d38b91f75bfb5 |
Close
Hashes for kgdata-5.1.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7c673c06228780191772045d8f218fc02ea4a9bc12e3a81f937c675ca0fe973f |
|
MD5 | fcf54af5fb7978db4b88064c126d9c8b |
|
BLAKE2b-256 | c462fc05d54b44bfafcdaa2070f15371f4183656f184dfa7cba41e345cf04f53 |
Close
Hashes for kgdata-5.1.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d45422b14ef8fa8ff625c91413e623525a4c620d90671526841df9ded28013bb |
|
MD5 | 9d2ce439e999bd9b146609809e325d04 |
|
BLAKE2b-256 | 09d296a978e2007c3a897c29319a16aa02086ad1c62e4ebae7072b56189a34d8 |
Close
Hashes for kgdata-5.1.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2bb8cecba81ebea8400c366734efbe55cb2f1eb0563928f85ca6e516e26c5d4b |
|
MD5 | 110906d3ed8059ec137f76f9286364fb |
|
BLAKE2b-256 | de3a2e1fd0cc082e39839495e3ca3c9b4387c7cb54c912f9fe91d356e2660987 |
Close
Hashes for kgdata-5.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa6e087c0da23fc4c70bdb84e27f3c3bb0528525182f4aef141c71ccda414a61 |
|
MD5 | 774cc36681e29ee61423f2c23725ab7b |
|
BLAKE2b-256 | ee0cbf7fac37cf92b24c278db4442881bf22bf53ae461dcad7bf1ff329a81c84 |
Close
Hashes for kgdata-5.1.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 442e31df64c99cc57d3e8017f5027b074da9467d7798bb85464292e58e90ea87 |
|
MD5 | 93d79c18b235c064322b0243ba2eb6e8 |
|
BLAKE2b-256 | 915d466eccdf203a45eaedfc3002a0b8440ea12e5d571fade47d4ad440e79f21 |
Close
Hashes for kgdata-5.1.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b5680421d617c7fd566b9ad7245599f37ccc0ca1b42fcdc61ef795ebdffced96 |
|
MD5 | 633407a7d578051fef8ce637bf580441 |
|
BLAKE2b-256 | cd073c98a05a8aa91c003204082c6fcb224a5933c8cba81da7270e52f8e2d763 |
Close
Hashes for kgdata-5.1.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ebb53b052d88eb1f0d34e86ccec362064eff8dd0560185fbd06547f0286d3ec4 |
|
MD5 | f576a7587fb8e5f52264f4b79bb0c383 |
|
BLAKE2b-256 | 9a655a0f66dbd9935fafebbbdb31da483420aa6ca390763f55bfdd4740d36844 |
Close
Hashes for kgdata-5.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ddfece061a231e72bd713b3fb2c5fcecd354ddacf8c9a8babd4a092c6e12ac6d |
|
MD5 | 769f865b043a45c70752a9f804333502 |
|
BLAKE2b-256 | 016d49979fde06892ba981879e41913c29904ae7127d5953395a66ec254717be |
Close
Hashes for kgdata-5.1.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b2560023426c12cd0873e50c5c32f76fe10b49523c6ede8f0b868a8a19e1e20 |
|
MD5 | df6fab3db386b31ffbeb18c2d0e53cc4 |
|
BLAKE2b-256 | 1bdcfad204401f4fa92a0b41428d73c38dce55d7ffc998bde8d315a570ec5ea9 |