Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.1.0.tar.gz
(113.1 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.1.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16c3639c54a8793b017fa9c421f719d028d72a69b5b1dd2684509772c07d6c62 |
|
MD5 | 879715c481525e4e7008f357497174b1 |
|
BLAKE2b-256 | 2050636e29fc47cb13dcddaae6111622d0a43151329f004ce13fa303fdbba749 |
Close
Hashes for kgdata-4.1.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 101d177c414692c8f469628960fc7caf29ff7ce3232a1a6d67cf1368d0d317f4 |
|
MD5 | ad2d7136bf6c985e409426d90f569515 |
|
BLAKE2b-256 | 905664cbec42fbdfeff004202954d5561e5644f94688fcae9a34c0840a444c1c |
Close
Hashes for kgdata-4.1.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cfcabdd24d2c44ec56a198d94a6202355754a517e18a293f527efa7219db06bc |
|
MD5 | 384b6912a00664d86a9e6bae7be1b846 |
|
BLAKE2b-256 | 0224a2f2e451682cfa2ce642eeddf185aef4bd3df29b0e2e598bba68de47ae74 |
Close
Hashes for kgdata-4.1.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2b927fdedbb9e1a398992c046e8e465ec4190660b227059f1f3cf14fe19324bb |
|
MD5 | cf2dd2488360222bfaf5c4a7c609b41a |
|
BLAKE2b-256 | 1c93f1fda264ce08488708f83a84334f50ed1332902319c45c98fb990b32a2a2 |
Close
Hashes for kgdata-4.1.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc87d3b65fda475fb90afa9a1ccad5e6af6b644a0185d7ea63b16e644d7af176 |
|
MD5 | d73f88af6bbf147e0d83c84fc84f70d1 |
|
BLAKE2b-256 | ab6d2c39d29a7b73eb9e3fde2e6370b60f5bb172a2014d66eb5c50b46f467f9c |
Close
Hashes for kgdata-4.1.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | be56fb8f7a504a881e93368192e919d7089b7ebbcd3639acaefa2a0e553d1b36 |
|
MD5 | a40f5d950c868febfe5cecff14474d39 |
|
BLAKE2b-256 | 86c798c2f83d0151b877d1ac3f09f354eed66025f9443aa6348abdb337aadd16 |
Close
Hashes for kgdata-4.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed818f30f6ec19ea3447ea55e22fcc9ff092fbd9f6ddfdb81b7e255b7bb90740 |
|
MD5 | 914e78ddc83641a1820095f12fb6e194 |
|
BLAKE2b-256 | 7d5c9ba99a6e38d50de880b52a3b194b09159147e706ca823170146de890a9b8 |
Close
Hashes for kgdata-4.1.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1657c169e06d73b8f26497b2014e948613395748b63515bb7ec1048863088f51 |
|
MD5 | ffb7a9250cadbc02c8b2b381453639ef |
|
BLAKE2b-256 | 08cde7202dab349831ecc2786e8027028705f3265b1815115eda64219d45b9d0 |
Close
Hashes for kgdata-4.1.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bedf111eb8d18839938d36b51dbcb3ab4a5b95e13f6d8c29d3fa08355baeb90b |
|
MD5 | 9c37d43732bbe752271ba34b5630db30 |
|
BLAKE2b-256 | ff13dee601bced29c8b1b4f1d3bcfb63dcee1c339e533867a7827b5ca48f52eb |
Close
Hashes for kgdata-4.1.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ffe9f39007922576e566618e44108a6d8167646efceb896d3afc48aba1d565e9 |
|
MD5 | 9da4e9c66c67206d8427c1ca5a5873e8 |
|
BLAKE2b-256 | fb84b09434756881fb4c826e259d45bc4f5357bbe8721df5be3cebcefffcd291 |
Close
Hashes for kgdata-4.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67923220ae8d17a017a50f859ad8beeda0a55b0cda5eada864e3afd7336411d7 |
|
MD5 | 78d4a2c755abf6f224e1a0449ece36fc |
|
BLAKE2b-256 | d99805de71d7c74aba83d0c92b8977185d7c3be976f90fd79c842086bb499069 |
Close
Hashes for kgdata-4.1.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d6aa4d7acacd05c2c662419d30ceba5f83234e6dee1ee166b748bfd99cea9278 |
|
MD5 | 0281b71a3c20af92ba071fb81ad6ea6b |
|
BLAKE2b-256 | 28d5c0054dd531f1708917c63326f5e592e97b040a99f9a4b9be732328cf7601 |
Close
Hashes for kgdata-4.1.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ac6946d1fa0ef3b0ffeffc78bf99aa20cc8e161d8abba7f1d35ee86d659f744 |
|
MD5 | 3cb8097f65e9050388c75e2f99ce40d2 |
|
BLAKE2b-256 | 39ec498718e54eaacc7c2620b40bd404891f587531e20cc4a0b3b77034a47516 |
Close
Hashes for kgdata-4.1.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8027fb20183fe9081b80566112b1a193711ff4196c2d36de796c129bc1d2f75b |
|
MD5 | 218dfc0365c8ac76fad9affa3127882d |
|
BLAKE2b-256 | c43d205a7ecb5696ff56cb2a232c82c6886c8fd2848a124d3f2be49824897c1d |
Close
Hashes for kgdata-4.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 916916ef10e137e7e077ca49449dafd8a0dabfbdd16ae7cac60d12ea9f50d854 |
|
MD5 | a00b7091290eb444463f0234443e356d |
|
BLAKE2b-256 | 343f7930c2f311bdedf1363819def75330e6e4fef2437af368a6a82fdf9de983 |
Close
Hashes for kgdata-4.1.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cadea9856c5d641c6933f7a80f376d56368e8147d8a7f2e8eace0c01284f83be |
|
MD5 | 484ac4aa281bd0124e53f3d2016038db |
|
BLAKE2b-256 | bf0083c6e04370dcb7cbe4a374e21ac90687a869059970903f5b3c712027c4df |
Close
Hashes for kgdata-4.1.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 64fa4c36e65c66dfa19dc3760d207cb9e7ab23ce08cad77ac6262a4da552eb83 |
|
MD5 | 344880c9448d6ce044aec757b5b634e5 |
|
BLAKE2b-256 | ad549eacaed083d4ec7cc693d4e3ed4796f80dc980420827c62492bb2d4f20f8 |
Close
Hashes for kgdata-4.1.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 239650486862c6c9c3fc4fa1e8aea596000afdfe4fbbcd855e0e70b053525bcb |
|
MD5 | 146ad207c8f90f8d9be545ef6c1f097f |
|
BLAKE2b-256 | 551af26158ed5b123605a3d24dfca45ff81e1feb846b4f85065f5075a313219b |
Close
Hashes for kgdata-4.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2435be577a85322e8ae35ae50212c1e5a3697601e2b68842b353916028050e55 |
|
MD5 | 27fb1df0b702d32371f89f05e5655067 |
|
BLAKE2b-256 | c3b10a92c886862bb3cf7147182034ad89b4e68e04551d10730e12cbc2e55b5a |
Close
Hashes for kgdata-4.1.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1611121cd497a91929980f85ab28208beb19ef9e847590d4988818f05d8fae3b |
|
MD5 | 1ce50f5f5975cb82eb22cb26def871cc |
|
BLAKE2b-256 | 35ae6a17e1757e162405f58e093e42240fe832b48e12d5cefcd2858f21ad63ea |