Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.4.tar.gz
(132.6 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.4-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7a8b84e042c100324a9945cf659e4701f358d5c9278835b5e19e96f7fbde68ae |
|
MD5 | 2f6a1f6dea943f8199674e9c3cc319e5 |
|
BLAKE2b-256 | 4d4d5b44329f80671a15984b1d4973e60b2d15c27bc4e9eaa0a9cf8e369d525a |
Close
Hashes for kgdata-5.3.4-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37fa4336ed09775faba4f63eed018481863ee5158a4f808dd69c16d056d34b14 |
|
MD5 | 48738a272a35ccd0e783fb70c78e660d |
|
BLAKE2b-256 | 6e6a4084e08dadc8bd217944524604f79f5f35d3c8fbd299a5793c3f8d70bf76 |
Close
Hashes for kgdata-5.3.4-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7cfcceaa8955f10a7a024be11c9061ee578187f4b1ca1063797b738923cd4041 |
|
MD5 | 9050ffc868ff551b3c6c388d38496517 |
|
BLAKE2b-256 | 35f2604da84eb48c8bebaf65de72496e798636196ba5fa839df7c5b8047eb24a |
Close
Hashes for kgdata-5.3.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | aa8234997731620703c08f5ebb2ffef8ad1afbb70602e23e18f16b9d879c907a |
|
MD5 | 6b0187d3dbb2e204be2dccbc7e61fbf6 |
|
BLAKE2b-256 | dfac864784b79a036d4cdb4c8a8bc8f8d02455fda3870260f62bffb70f5e026b |
Close
Hashes for kgdata-5.3.4-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fddaed1a7ff6230c82b0d216ced939572411c2c8795b8377106ff1e56ef8efc8 |
|
MD5 | 27d75e42954a983aa1d8fdc7c7be47be |
|
BLAKE2b-256 | dea7751efa34bd0e88b69c314dc786fe4c6cf021709ac84778fa22e1883b3c10 |
Close
Hashes for kgdata-5.3.4-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 52b0dc33d70a051c0efff76e4fb478ffaa47a057c7d728415bc0c1a06e58f71f |
|
MD5 | 0637fefe96bb356c336b4ad3001d5885 |
|
BLAKE2b-256 | e061724bb6d3992fb0f66b0291bf1e822e79da139b3cc49be4d41e607cbe6067 |
Close
Hashes for kgdata-5.3.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 512990a3eb2dfbf21c0a69e893f95886504abeae170f3447ae35ed7e2c4cfe60 |
|
MD5 | ea5880de0314cb9d0b7582db57f9f90c |
|
BLAKE2b-256 | f6b41468014dc8999dbdd8fe90a8a1cd9c81bf965180322d6e0102205cb61556 |
Close
Hashes for kgdata-5.3.4-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fa28f6647047d1886138957f86d3af97b0e89efb999f433faaba66217b6c087a |
|
MD5 | c39b0ca54f58004578c68c4c2e7e49dc |
|
BLAKE2b-256 | ff54c2fbb6eb2e69e8eceffa02ff7bbef43e338a38022c100bda9be437edd9b8 |
Close
Hashes for kgdata-5.3.4-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d7a4c13c3d1d0b4d2a59a8171a5c5925d98bfd790e4e1cd23ef792d00a40c315 |
|
MD5 | 563ad72c40351bf9007db2d63d5fa243 |
|
BLAKE2b-256 | b7dfcf1ecf697eb523a8d1a48a298ac30a9063d295fca24cda566e4333b4037d |
Close
Hashes for kgdata-5.3.4-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cda1bba4b4d4a8da8c2616ccb7a8ce52b9dce18512c5f28e2364bf8b60f13f5b |
|
MD5 | b8a24ba68284a8b29e655602928cac0f |
|
BLAKE2b-256 | 522f354322a1b76ff8e7136ab657fd6d1706b9ed1cf66d55f8d0baa67740fbe4 |
Close
Hashes for kgdata-5.3.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c584b16dbec94e2f16384b6da42ffa8d0eb2e09d760c9019d5614e15e347f323 |
|
MD5 | edee9a690570098135bb1c462d7761f8 |
|
BLAKE2b-256 | 3b440d9730c8ad2fa0d89f45571d530d781031997b5d613148fefd9f78b4a376 |
Close
Hashes for kgdata-5.3.4-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f44e6eede274f409d3b3f51a65a520a99dbe4f2a4ef7c4729074c7076d81f2e5 |
|
MD5 | 78c3e1723cc7601c1b75702c7f7b1fac |
|
BLAKE2b-256 | 714ccfe72864b1f87a0a44b529eace80509e95b5c451ab83a2cb4f5441783285 |
Close
Hashes for kgdata-5.3.4-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9f75fc444a35d44a4ff303380aa2340b1ef0c601f3b30d2f8d02b370afdfe1a1 |
|
MD5 | 58f85b976fe70874d966e56503fc9aca |
|
BLAKE2b-256 | 689b0f1ebe15df4c01ab3debfecbd184796d4ef3be6e78da4fcfa27da3a74180 |
Close
Hashes for kgdata-5.3.4-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9096ff93b6272421d359fa1b0193b7ad9b3d2ba1ca159f4eb3960a665f830b5 |
|
MD5 | fcd6d73c46821de5cd60d8e875ad0d27 |
|
BLAKE2b-256 | 586728edf0cb3712a8aa4522ef62742844a7f7ce12a1e47a7534c792b5d9909c |
Close
Hashes for kgdata-5.3.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e3b9ea8553df9ba10c733f1ffc1a818a046263d656cbe9a3d78084dbf1c951dc |
|
MD5 | 49a6bafbcfbcbf68dad79e317119c420 |
|
BLAKE2b-256 | 5b7b67107c3d7507ce1948aadd91f68cb6a4849909e7565dda1d06f83cbf5f29 |
Close
Hashes for kgdata-5.3.4-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d2f17dc1d662e645f9db10676fca2636ea6c12599a0e926b0b286d6370e7b68 |
|
MD5 | b97d74493fbe1372b7fd058f3a7446c9 |
|
BLAKE2b-256 | 518fc8b3da77cf62c5b2921b55d9adc5f31e6fffe184aff68aa82e968f1fba57 |
Close
Hashes for kgdata-5.3.4-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95c4a291f6b33bde0db14ba2e3f893ea6f16bd043859bbfcb3dbc97fb7e56667 |
|
MD5 | 37f91a4f3ea88ce0d616309d9ba3ec58 |
|
BLAKE2b-256 | 9575b2fa02614120fd94c69dffab624bfa4792e315ae7e83f23322f6194aa9f3 |
Close
Hashes for kgdata-5.3.4-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 425919e93ae646990d9a06a137cf28b8a86263c9379396d2bab7fdeff90e51ae |
|
MD5 | 6b4bbf26aa0ea23a452b5650801bd667 |
|
BLAKE2b-256 | 17498d8342bd93afbf7c91bd82d710272dd883025c1031352ba06fb853ad02be |
Close
Hashes for kgdata-5.3.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5cbd89a5a73edb9d410faff2fd85aef29bcd7c7c6b153302fdd1677d9ef530da |
|
MD5 | 6e29abb74bd1fccf16acfdc16b3b76a9 |
|
BLAKE2b-256 | 2afcdf4775610e21775552aadb21968ea9ab32c1b28491765d7823373598554f |
Close
Hashes for kgdata-5.3.4-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9ec348325744071ac62e7aafe6d016b18e02ad352274a67a4cdffc0cbc183e5 |
|
MD5 | cfe5d94351b2964b7567f3d5c4c74c23 |
|
BLAKE2b-256 | 9b0bf5e3ca45d0426ca5d8d90c2b8c0d278496dccafa37dd826046480b2ec9ad |