Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.2.tar.gz
(132.4 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 603b4efea04bf60a45981a63058ec7f5db7511f03bc57543cf14d232165e4c3f |
|
MD5 | 3612fd5b59c14f35f48244c3d17aff32 |
|
BLAKE2b-256 | daa0dd456a64fd35bb57502135b59aae507676477596cad014ccbc78fce1093f |
Close
Hashes for kgdata-5.3.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f2ab79177f2cede5837da9b45717a9339325c881c030789af532656af74c67f1 |
|
MD5 | ceea979801fbf300069f88f78413d503 |
|
BLAKE2b-256 | 53b950d19ffb213ea5f62ed6391dc8501cb737255fefd9d562d89976aa52fc4e |
Close
Hashes for kgdata-5.3.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9b30760ac537f0eb59f7aa7d68ca7ef5e57259a5169f8bba962d53bbb0da8f76 |
|
MD5 | a34ca5b4dcea17b86ee09c0758777a3d |
|
BLAKE2b-256 | ce9210e02cf6f2184de3d617aeb1671045090cea4646e1987e79c77ff3018f27 |
Close
Hashes for kgdata-5.3.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0fbfb897715d4d774dee26a4628846fb6388ed3573a459b86942790f14648a1f |
|
MD5 | 0c4a5ad0b9e2fb3a0a247f0f6ac22dc2 |
|
BLAKE2b-256 | 94bd673c0a2214f9c9820b190e0d591931c8310d574e08b795d11014547da1c0 |
Close
Hashes for kgdata-5.3.2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1e9de31668e1857c6f51adf37c538a671879a2fe0689e2fad575134ef8bc29f9 |
|
MD5 | 64396aca42ac3dacfbd7c6f866dee39e |
|
BLAKE2b-256 | 7186297d3e0db6702074b14567cd2f6057ea54252446133e0c208e5e62496caa |
Close
Hashes for kgdata-5.3.2-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 99b668cc4de9f190eb2ca4fe88927034f968868abdd807e639e365d76ab491b7 |
|
MD5 | 17183c66dd7b35f02d04414493626fef |
|
BLAKE2b-256 | 2ee41227d3eeb556e46ef91bd9192cbdecfe2376cf07a513de0a01c98b79a45b |
Close
Hashes for kgdata-5.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8f394335eb3b17228356eb309074da29bf31aa129c465cbec49b9692c1cd5715 |
|
MD5 | 24d84e9f6f4c29e358859d942ee84bb1 |
|
BLAKE2b-256 | 5fd13808231db0c1e7eb8655823d2d3a3424f26a681ebbf2cb0e3218704b921c |
Close
Hashes for kgdata-5.3.2-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e6a43ec2c3ac5d1f215a006cd69ab6c47ef6720cdbb8b1ee76b6aa79cab145a |
|
MD5 | ce1ac40b2dfe4a7e84955a28a488c7e6 |
|
BLAKE2b-256 | 6d1ee5566c0976b1920f5b2bc174530b4f2ce7421f5b21e085d23d1ba686a0c4 |
Close
Hashes for kgdata-5.3.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b21876f61c2b31cb1828de1bd17eacf6936da8118863afb26f40a58e37bb8c1 |
|
MD5 | 5a5bd536bbc52ffdd94a9e82eb4e8036 |
|
BLAKE2b-256 | 874f6ea25a671ccc84a6e58b00fcb348f0bdb370d31d6df858190df97f16c4e0 |
Close
Hashes for kgdata-5.3.2-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9778084a805f49e3b44e1c1bd48369ff6c0e319516d30ed9f6651644235e9720 |
|
MD5 | 60d7bfe99f84e892576b2d9ff99e9196 |
|
BLAKE2b-256 | d93d11cf23d51d6470d6de306809d38947faca6d7a98daf50b2b13a79121f7ca |
Close
Hashes for kgdata-5.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4aa4caff2f7796702235d31308255d9a32e41343e6c09e00df34c9d05fbc083e |
|
MD5 | f1502afd49ed69d9ca7edbc773e7271a |
|
BLAKE2b-256 | 29fd82325a6ae707d8fd6f5fe04efb52cda5a9adfc3731b478d9283355275132 |
Close
Hashes for kgdata-5.3.2-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4cfbb47ac4ade6b7f5dc9379085f41c38c587484e4aad01d568d1e12b5f64a0e |
|
MD5 | 662ce326b30821d17b497b2de928117e |
|
BLAKE2b-256 | bf3365fe33037be664dde90bb0b570da14dc064d75a7b74bca4056d904667bb6 |
Close
Hashes for kgdata-5.3.2-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b3e866f3946aa976c2024ee58da4b33e61571754a9a13d839ef0a231b7f9939 |
|
MD5 | 23004551f17adc379de8cf16b68b81ca |
|
BLAKE2b-256 | 0762424672c13529c60fe12215106c2feff1fcbde10ea379dd44e2173789c9ba |
Close
Hashes for kgdata-5.3.2-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 449308d797eb6080bfbb1f44d0f34d169b254f6ab98f209e1025006111ee4bab |
|
MD5 | 6eb40f0f4be7933ee0d08e76168dea76 |
|
BLAKE2b-256 | 575f4f46a513df7757f088c9f2314cbd094a33ac624afe6897406aa8d7628e6a |
Close
Hashes for kgdata-5.3.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 695ebc3e47fbbfe9c7a900b9a0ee60974a4649c392f919627a3ce70b077a06d1 |
|
MD5 | d6da91449e1c3b946e3e9cba587d3d34 |
|
BLAKE2b-256 | 19fc82da552559260eeef2836078a8f98297f0142d9dcc32f58e96b666b64c16 |
Close
Hashes for kgdata-5.3.2-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbf894efdbf640aed43ac87f324297e2ba8538f0e792e1f70e82eb69857e0d5e |
|
MD5 | 767328650bb2a220dfc94180c264a36a |
|
BLAKE2b-256 | 52e52efeae98999c4780d892465865d8d0903655f33d58ad06457ed841d68991 |
Close
Hashes for kgdata-5.3.2-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbabbffdd4e63b55bb1c83b38f7f9fb6bc303c777464de51026a7821ae1ef7eb |
|
MD5 | 668508907ef6eeb4f8a0fb4560e8d6f4 |
|
BLAKE2b-256 | 271be5b86d1ec2dbeb5d9b5d23c58ea318c6d5eb78cfcf473b63c03e067a465f |
Close
Hashes for kgdata-5.3.2-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5258fbe1cb162a60a1b66809ffde56e1cf67a80704d835398fa281969274dab4 |
|
MD5 | fcb98eaf1655e472d16827ebf8bacca5 |
|
BLAKE2b-256 | aa7af1eac8db50ba611a4997747c4c75335534adb5504ddb248f7e84072e083e |
Close
Hashes for kgdata-5.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4531218348757508bdc577744eedd96db595991fa6724636005d7d3da4b9998d |
|
MD5 | 59a38776ade7be61c5b206fd9bde637b |
|
BLAKE2b-256 | a11f0134abba01e447f3c11fb0eb171a6a4867f080572868035ec6663f61ccc0 |
Close
Hashes for kgdata-5.3.2-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 09dcbf38fbce502fc66b7f6b790f8667159a612064a0efa4e7707a66eb1d8cf7 |
|
MD5 | 44d047f9706fe72e314d631a946add99 |
|
BLAKE2b-256 | 790d30a54c1858019f69af8e2b4797a2fcf67bc8d6fa4acc9eac63d00a5b5c18 |