Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.6.tar.gz
(138.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0ab3431aed5f167148750f93b6cc0d4f252b79b11e6edd8cf56b4f50ad91eef6 |
|
MD5 | 6126d749b9443b0d79bc17cdecf88e19 |
|
BLAKE2b-256 | 04ecef006278f58fe3788665582323aa2f0de42ca4185282105ad479eb79e23a |
Close
Hashes for kgdata-5.3.6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78348f7355a48629dd18828cda5830f28c876bf3760c71a23b1da1e0a623ff4c |
|
MD5 | 743bcb32cb76cd63c8138527391b3578 |
|
BLAKE2b-256 | bb4081ae6df8405c52e594bbd9f93a4cffd8dce7c00d6aad456ee749ad9fac20 |
Close
Hashes for kgdata-5.3.6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4fb492361004db8f6474d06344b8c783960b25f5f59d51de1de413143ea4d17b |
|
MD5 | 86e7af13a556ef7fb0ab22f12fdabd0d |
|
BLAKE2b-256 | 31d35513fa6a9b71d1b0aab0dbfc9a17eb3573be13291522c6f71f480586489c |
Close
Hashes for kgdata-5.3.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 38f5aef202afa9f2914d8d2c58cad56ce4741be6e2335eb442ff71f1e94c085e |
|
MD5 | fd7a7e5fc130c3d4036e8ffca5f7383d |
|
BLAKE2b-256 | 723df929f4fe74e57f36c0a554af67a897df4b4a577472bfdbbd679bd72d3311 |
Close
Hashes for kgdata-5.3.6-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ac8b82ae85a3c2fed462ebfb82e3dccbce2c0a84cc2f499edfbb18e56365cbb |
|
MD5 | 8e02d39b09ada64f6085ae1031741db1 |
|
BLAKE2b-256 | 321e9f8bf318d0c6e0e32fa3bd3040b668acfda5c9a8a6c07de67a46f9db5fbd |
Close
Hashes for kgdata-5.3.6-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | df5b54ea27172944742d414081e770a6a1bcaa0049e7df6cde34f7c97a3d1e55 |
|
MD5 | bbf61f45291574ca3c5ff316ade19d89 |
|
BLAKE2b-256 | 8903cbd4e7890c8a8315cd001f1309bfde99c474f4fba4062275d45c78b40e1a |
Close
Hashes for kgdata-5.3.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a4736f2d5007f47711fb56cc9cbc976a9b024a34d5780d4a37d28a451c84d3d9 |
|
MD5 | 203a315145b97e3b74dcb09ca56f01a5 |
|
BLAKE2b-256 | 91c58177e4ba802619b7d9f3b4c1598b983692ed995d3b4271c81ad825ea7c66 |
Close
Hashes for kgdata-5.3.6-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ce0eb29a238c81894246f8c4c458cc4ba0fd2138db98b01d98c59108b336783c |
|
MD5 | b3337b6aee4f87b6c50b09dcc88213f5 |
|
BLAKE2b-256 | b7a6ea74c33b97b5353a7dbc7026aa6b99d70e74c8437e85525313015a411c9b |
Close
Hashes for kgdata-5.3.6-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 617a006421866eb71ee5e12b71b26734dcff1d970058e77867a8bb513e78ed57 |
|
MD5 | 974623de0dda48780f2109b5e563a315 |
|
BLAKE2b-256 | 00ec2c387ccf43c07efde3e5f4581fcbf166d36da194af450f427073308bbf45 |
Close
Hashes for kgdata-5.3.6-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d87ef1e1843087d10c67cf2612cf311078de11dabb9abe1d93320269a96b3d6 |
|
MD5 | 774859ed232243940f6fa39060f2c63b |
|
BLAKE2b-256 | 4c29657af207c5f6e1786e1958453597b93db347a83f6a23a9688398edabada0 |
Close
Hashes for kgdata-5.3.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc7bf41e9c7f4f1b9e5df3d04864081b6772544181dd93a8a8766303bd8ad6c8 |
|
MD5 | 8e5b5f328f6440d555f92436e9b63df6 |
|
BLAKE2b-256 | 0e4fa50ce6e306de6efc0ba266fe8d8fa34493e54050c27105a7e786af743e0b |
Close
Hashes for kgdata-5.3.6-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b83f582e0133faa8abdc433545f2152248205904ddc60fd91a7e0bdc5a0527a6 |
|
MD5 | 3900441131084fac37205ff81486f764 |
|
BLAKE2b-256 | 838a49b9f0a4b78195db9b7be27218d7b100693d8e5df51253cb70aec7f1be86 |
Close
Hashes for kgdata-5.3.6-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7649b492784b0139d2a6021dd7f4d55cb965f0a193a939d3f70f55848657cf6a |
|
MD5 | 26983c553e44e938432dd71d05420bc7 |
|
BLAKE2b-256 | c5fbc123e4852641d03fb2d56079928af2e631301c58f1d6cd26be33322b84c0 |
Close
Hashes for kgdata-5.3.6-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3d5bf2692f24c5ad659c589c929a04189e5ff9837708d369cbdf9f73f0d79ff1 |
|
MD5 | 40785ed53acc7c4f0b3938713c1a4f36 |
|
BLAKE2b-256 | d5aeeaa4c3d0bf4f5753487b8f30d553f878157e1bdd0dd2668049a13a1505ce |
Close
Hashes for kgdata-5.3.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6ebe1d69bb7d3175579358f2016fab12ea28bc0d7f9eb42c7c57402ed91c8826 |
|
MD5 | 8ae66fb612b80076df5bc17b85e8302b |
|
BLAKE2b-256 | 441f033c9cbb9c7f0151379dcf4cb1a6ea4329eb363077aa9efca3d66590ecf1 |
Close
Hashes for kgdata-5.3.6-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b11a88231508498727c8052bbf990f4183f129fb5976acad88a5ef32b7f7ca32 |
|
MD5 | c6f9a527869e9eaf62af97111da396f6 |
|
BLAKE2b-256 | ddb0cb8df7f04ddbe6b97e0ab4f3abfb216e5da9d552b8839fe0e9893b6a2a3d |
Close
Hashes for kgdata-5.3.6-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2690edfd4c1b8dde8d4e9801ab8944b79f1d3121b7801418d5adc7129942f6d7 |
|
MD5 | 5fabe7bde6bcd69ddcc4e6c6d423b792 |
|
BLAKE2b-256 | ee82086f0d8b260600b843eff68b498e7db18ac8f80c4f8cc957b3e4953d254a |
Close
Hashes for kgdata-5.3.6-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0be3e7874cf1597ae4a81f2f765b9aa48a3d1c5ce1ff82447b411f8d62ffaf43 |
|
MD5 | 1f63546d20516b2debc2bd5e07189be8 |
|
BLAKE2b-256 | a59b7830479939d840575a2ed1da8ae9ef0090e91fc2a19582385ff5571da202 |
Close
Hashes for kgdata-5.3.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95cdc2c8d6f76fd4f4c4eca9e4e0a3cc1975f670871326bcf77d844df024eefd |
|
MD5 | 778332c176ded94d99755344678a8e58 |
|
BLAKE2b-256 | 7d2d5ec271f2791008050404f24c453dfdd76677b1e8438568ffc9e89e319450 |
Close
Hashes for kgdata-5.3.6-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44272deff31eacc91f1c31e965c217408f1c1537993964e30394d78b2d0c02d0 |
|
MD5 | 395304a8490782da8abe270c60af1ceb |
|
BLAKE2b-256 | b48631cab4f977cc3db9d487668850a3bf3fda4f3c94fc2f711363807d08da23 |