Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.1.0.tar.gz
(138.9 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.1.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d347cb5729c6d841fdad80b2199ff18ecdf006d9492f0d08929c9107887bd8df |
|
MD5 | 03b01ba8c04ab3a350111c3ba7d312a2 |
|
BLAKE2b-256 | be771b9b95ed70d4a7b01d167b1bc8bbe857c4ef602f688b043e5ddc28468c96 |
Close
Hashes for kgdata-6.1.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7492214da068099e1be7ca13e2d9b380ca45be6dc3401c8d0a8b4c18a24ee800 |
|
MD5 | 0ad68d9961c0165721ca3edbec65765d |
|
BLAKE2b-256 | 806d6d3c3b6dde4f94dfa574587fbd834cb780d366879bceca947dd21e777760 |
Close
Hashes for kgdata-6.1.0-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 419c56b8c978b660d5cd6913a3b9ba43fd29751e4c6c2d641fe6d4a6113dd29b |
|
MD5 | 2c90d037ea4e2495ca4661d0b834fe30 |
|
BLAKE2b-256 | 4a02ed01aec5712a48e97e968c4d4a3f572b3b891bbe8a9b9da16e13218aa54d |
Close
Hashes for kgdata-6.1.0-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f0929ee8f9367604b74ea92e4c55a82032f69cf8fb31939512b0355a721b454a |
|
MD5 | d4566a91cae23b29d04a018f13287cb7 |
|
BLAKE2b-256 | 0fd72abb767c59ac34e2dd75767ee9ace7f1b717707d3e4b06bb79aa27daa792 |
Close
Hashes for kgdata-6.1.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7c321e2b3b4bdce06ca10cf0a222c6d72404987966dcac021cdcf6773637b411 |
|
MD5 | 9de7dfa113bc4736780f41a2bce112bc |
|
BLAKE2b-256 | 9871e7aedc3f44530735e5bf9c761daa67581306275f5563ab607e3b0ab2c708 |
Close
Hashes for kgdata-6.1.0-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7026f23a0297616a0b82431b199b0d4eb1fa46217f9232f2f971f4b0aab72e4 |
|
MD5 | 8b3a87d930f5b687582d775227c09064 |
|
BLAKE2b-256 | 6799694b0483a09b63a0e6e4b46a5a7be8a32c7d34d702a95fdd7eab3cc6b213 |
Close
Hashes for kgdata-6.1.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f3118d8af43ff1ad3ea73828e474ea9b020e8e74ff18d193b187aff57263dc25 |
|
MD5 | 2cc8c15b32d69872f65743cccf53ba48 |
|
BLAKE2b-256 | 53d69982a4b4173af58d5d2461cdbebcf178584fe1541620eef08b8c28c6fbcc |
Close
Hashes for kgdata-6.1.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0887baca42ab14075388540b6252df55b5239f3a892d75b350e3f2942920558d |
|
MD5 | 2cc7f636c33642306cb5a98fdf3aa78c |
|
BLAKE2b-256 | 2566e8fbb8e54d889f5fd14f8c7edeb96fb3acd24966c1734c380d4fd8eee79e |
Close
Hashes for kgdata-6.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a33ac4d23788973017bdc7f16360c71d152458a231117fafc48d689b57d69845 |
|
MD5 | 550e1e8b8926b655268b93ebf39970df |
|
BLAKE2b-256 | 79731a465946ff179d1a29cf4c52e51b906b7960d00acf07586c775cb8072f9f |
Close
Hashes for kgdata-6.1.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 86edb503a1a12bdc5de1a90b45d0f8a21c187903317a44f40c8de632c4d866df |
|
MD5 | 20135c1a012dacbb4cd0292f995b7041 |
|
BLAKE2b-256 | ee5b98260f7fd690d752b284ea444e53edea57c2bd926730621732ae333327e6 |
Close
Hashes for kgdata-6.1.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 05e1dfe4fb31ae6d162cb6c31e695e558f76143f22ba5394190e8d5f6928af8d |
|
MD5 | f2f869ebaeb096438474d80a59ac8fa9 |
|
BLAKE2b-256 | d710cea8e2ee08a84883958ee9e02db8cdac23aad0718c78617bcd159a30adff |
Close
Hashes for kgdata-6.1.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2e97e356686589af8f448e65c1041430394a4c0e796ce7f2af05058c7169022f |
|
MD5 | 5a37ba26206a1c41eb4deecf6941cf1f |
|
BLAKE2b-256 | 0c50b980547d2a89ab1f99debb385bd10f1cd6fd9d4a5682209bd6d5e0def907 |
Close
Hashes for kgdata-6.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a311b94f12c7ae6020b2f7fc579a466bc599c7eafd18da43e56894dfbcd38208 |
|
MD5 | c02528680552a1ab47b9bb332371c740 |
|
BLAKE2b-256 | fd78957cfbab54ed45da65107fed18e97e7cbe1b1ea79de2ff024bf243228fcc |
Close
Hashes for kgdata-6.1.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca33b76cbf4a05c2508d352b690b1056a83f4bb83f32d6b111cc1061312b04c3 |
|
MD5 | f134b30c8d001410c6e3a791b7182597 |
|
BLAKE2b-256 | 7013a5ffbe8894203489ce91f20c03a5c164496a120ea3fff86883c32739024e |
Close
Hashes for kgdata-6.1.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c644d6b58bc9c5ae33249f64af24970729357e157a75e95afc756826033e0a7f |
|
MD5 | 5029b7471eb66eb380eda305e3baae62 |
|
BLAKE2b-256 | 647b6d1b093ab71cf6a109d0fd56750a1416d244cbe4ce116df27604dd8bf650 |
Close
Hashes for kgdata-6.1.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 79db4ad71306540665ab28f72cad7a058284093d56f0ab1c4a8668ed823d533a |
|
MD5 | 0ba4c6879cbb17e19e83cbf8d3ede909 |
|
BLAKE2b-256 | b9595f6f9ae584ab7427b837fdcbea736eb4b4d97a6b439189d016bac9be10a0 |
Close
Hashes for kgdata-6.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 13745593395786c85571a2baa3fc03d8b6c855d87c33567512dfd61880e6c496 |
|
MD5 | a6bbaaf48aafad84f2f9245b7b762556 |
|
BLAKE2b-256 | 5a821f207786f282e3f0996568ea3f822310c03826c60f443beca26ea4307375 |
Close
Hashes for kgdata-6.1.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0faf7aa890c20c4373df10b687c960310708c60f75f6666b59f2dbe3a2062c7 |
|
MD5 | 79bb03f44d0269be7fcb65a2f2d7f668 |
|
BLAKE2b-256 | 14554263bb065b8a213151d4857348482048c3392847944704f92b7462100358 |