Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.2.0.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.2.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42ef024f71e72afa2cda3793da3184aecfb707ddc1b3a44573996a402a51b037 |
|
MD5 | d3605c089ab3e282a56f60c5781c248d |
|
BLAKE2b-256 | 18f108ad863b1f7a0bf7f4984dec238b28423c63b432e822f3ce93e99673404d |
Close
Hashes for kgdata-6.2.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d2a5c9d9922d711cc9caef0d77a0f93e44407eb11d60cfa89adebc858c5fdcfb |
|
MD5 | a4132a91b1caf96360c86e8402cb4605 |
|
BLAKE2b-256 | 0ae0972ce20fe418a6b3b34cc002c7c8083a95046f93b0b641b2a03501f06cc7 |
Close
Hashes for kgdata-6.2.0-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0f6cdddecc8dafd5f6ff737c29818ff7167bed35eae620667152a3247e1c4041 |
|
MD5 | 1960f6573faa29878af0a26a23dc8fd6 |
|
BLAKE2b-256 | ea8c9912b90ff2ad3ba8454bda4f143b61feb8fdd12487061ff05b0bae6a31e2 |
Close
Hashes for kgdata-6.2.0-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f10f3e1e16ce0687e3c9fd288b649be7c0210aab0783a2e0504f759858838fb |
|
MD5 | 4d9fb848219e57f3b30c5edb422f668f |
|
BLAKE2b-256 | 6de25679ad2518f18016e64a69a6083112aa398336b05276032bb5a324a09314 |
Close
Hashes for kgdata-6.2.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e554d04c11b7557ba52d102d6fd5613eced606c7fe074efc4723c3e9ea601803 |
|
MD5 | 82270f65c9f7b993ee462dd6cf2e9fe3 |
|
BLAKE2b-256 | f27fc54b468c0ee42ddc7dab71b9390443e481288a7ae4a57155defb8739c300 |
Close
Hashes for kgdata-6.2.0-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9ffc7859ed37972a11ac38e9d0268126b390a722d68d4d646a68347b372315e |
|
MD5 | 2e9bd1064a2b445a5085cad418135729 |
|
BLAKE2b-256 | 98b958bb42ac80801d9a3b9c47d4207ee998dc28056ead706471f87d2bb43eb2 |
Close
Hashes for kgdata-6.2.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fe9e42c0da5c0aa946141128217fd2332ac37032e01ba850378cf627833daf7f |
|
MD5 | 2c4d0d5e338dca335bf4176c2141e89a |
|
BLAKE2b-256 | 5cfbd921b997c5a99759bf70596fd497372f63aa91727217e8c9bf9ed3abfa31 |
Close
Hashes for kgdata-6.2.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 52b26dcd5036cadf5b317a7210377217eecc66e73f4b90b191ecc6374ea313da |
|
MD5 | 0851ba3bbb92c93b3faa14b1dafa83f2 |
|
BLAKE2b-256 | 1381187ca02cb4c2d083cb2ebc3d982df488d9ef2cf9b52c91da351f02bf25f6 |
Close
Hashes for kgdata-6.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc03cbdc1724ddbf6dde1d5c91bc27a43d0fbe818474119518ee57c9c1535c28 |
|
MD5 | 573cfff55261b139e3d7ee9ea0e10f6b |
|
BLAKE2b-256 | 471f88403e00f9a7c0fb63973540062c4e635b12a08928902d1efb985a6d0851 |
Close
Hashes for kgdata-6.2.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0897d85d54f40673c2345d32aaf98aa385940d59905fe3242312f487e6724b0 |
|
MD5 | b4d9f8a7fe694b19142d253960c0a7be |
|
BLAKE2b-256 | b2d48ce39cdbdbbf39f9a6daf04c8d07fe70130164300c1362d6314c34193040 |
Close
Hashes for kgdata-6.2.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 51493c7398c6607f94ed09474d50a84a7353595b51e53896b5acb03496d251d4 |
|
MD5 | fdba41fcb1af4ff9cffc349eb41a970d |
|
BLAKE2b-256 | 3dc606bfcee1fb38fc1bd13fd851d3d05817596bd156375f7c1d1424323db2a0 |
Close
Hashes for kgdata-6.2.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2bbe854b88d50ddc13b65aeacf322b938fa867fa7fd1d133e121ef843bc5cb51 |
|
MD5 | 81d963d7debdb9468de2b95b325a03f4 |
|
BLAKE2b-256 | 2aef22e5845d063c41a9acf553e2e4f9194b283005998cd14e786386ab837bc0 |
Close
Hashes for kgdata-6.2.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf317597141564ccdb734f3a12b97d3dfb3998eaca62345a026fbdf856353e67 |
|
MD5 | cb7eda5f2f7cb6ae39f7617abf13bcfc |
|
BLAKE2b-256 | 32912199671bca1388fc266edc94d2ba89a4b0ac5de5cdb13b94765df471564a |
Close
Hashes for kgdata-6.2.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | da5f63a921c0c8e6f714b2e0c9250950cafb66f7623b1475b481f87fb2ce7db2 |
|
MD5 | eb40939556df47f7c4a0cd09dc6c1c74 |
|
BLAKE2b-256 | 352dd140209217e9917a4425a71c6d6a8e81aef560bb9a4ade98f8d815b4284c |
Close
Hashes for kgdata-6.2.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c4d0442ce7388c2637385de5f7666c77b180fea3d64fd849be7d97bcc088d735 |
|
MD5 | e6a5428dde7e3836f15a9881de8a3473 |
|
BLAKE2b-256 | 7f5f24b37e7f68f31070826cb5d97caf606a4a1d9b8277aac49a31224dea20f5 |
Close
Hashes for kgdata-6.2.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3df52da563dcfd0abe50e5ce0f3be15e9319353f0688452ca9e0f4a05418b487 |
|
MD5 | 9e42e7bc7a0d3319f2cb28881439a8d2 |
|
BLAKE2b-256 | 5dbdb58e47b9c006043ccf8fff18d53d92f3d878fd394f78b4dee267d34cde07 |
Close
Hashes for kgdata-6.2.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d3c60b83e7278b5001e9b7d7fed59e8dc87381357111fc6cc445ce8cdce987ba |
|
MD5 | 4644a58610b7b67e676779ec99d4bcbe |
|
BLAKE2b-256 | a6b1259ed67d3af384e8e5d26ad654e455e8b784c8faf71098cde9e267f80d84 |
Close
Hashes for kgdata-6.2.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c09bb5ba6b84f9ad1140b6adfe935f5febe8f689189fc817310833ff7c166eba |
|
MD5 | 5ddef9892559152ba9297ef78b538eba |
|
BLAKE2b-256 | 8e38313f4f1cfdef22fa189af08f3eab6cdbd6c7cd51abcbaf64a91dfca4d6d4 |