Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.2.1.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.2.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 17bd7c933dbfda4fe3d8700f6600aa865de33a8484ca93b75dc0959b8a6c70ed |
|
MD5 | befbf2207be05c8edf0f73712b687877 |
|
BLAKE2b-256 | 11a80ea87f97ffee2d6243a4cf2a77f181a51472d178af3fafb2572597a3a114 |
Close
Hashes for kgdata-6.2.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 384f6895bb64e92d43b8e1bd0bf3329ca43827028280083ea579ff0db75d2cf8 |
|
MD5 | 7769137c8ac89ccb5d2082c43826edb5 |
|
BLAKE2b-256 | 38aa1a2ce9fa5957e010e1333fe21c29587ffcad29a0cafb150823179377b0be |
Close
Hashes for kgdata-6.2.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc99cd15bf3b7be4b0de2eddc61443fe2f512c9b7ccdc07256d892d0ef845fc8 |
|
MD5 | e8030f5d81238c16ac701aac4436fe43 |
|
BLAKE2b-256 | 9f66d6d0589f1347161656c7ebee94b74e45e52aff023a9945252d369b75dcce |
Close
Hashes for kgdata-6.2.1-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 737aeb71d4d21136384a273a66db4270565c9c4cc3ed3e664b953bcec1fa2fb7 |
|
MD5 | e629dd1c696dbc7e65a0c9f8c5483efd |
|
BLAKE2b-256 | e6a7cd41baaa57a25f5f2d7fb8e328cd765da9a3728fc1fb054976ebda3e2f44 |
Close
Hashes for kgdata-6.2.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc6585582804649220ba33e6e04ef131bf00bd6ee4fd6bc879fc07cb532d74db |
|
MD5 | 0f755cd1676ec2f7ef369e36d72f588a |
|
BLAKE2b-256 | 698ef0d3b8954bb840fff5eee4855b96a02ccfe9d355c1bdc985291ba32f79cb |
Close
Hashes for kgdata-6.2.1-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 513ea142e0dab2edb7f5fcf0a65cad678c0fc81f578db423a062afb661d7f320 |
|
MD5 | eadf929f1108c245d802af86738e17b5 |
|
BLAKE2b-256 | e5957c8822066e70d7e8f73965a4eee6759138bfec601220f785434acaa69c2f |
Close
Hashes for kgdata-6.2.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a91d8cc345bcb58a7081d9e03ced0beef4990929f4b48fa0194bbf57a8ba2564 |
|
MD5 | d5a150901076e038b9667f7dd2c57fa5 |
|
BLAKE2b-256 | 750136c11019c97be66de0f5bedfc1669483c61cac5f2f7c3c3b59b3c8c92670 |
Close
Hashes for kgdata-6.2.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0ccc2c9ddd0d53330913926330b82a5264d1d4f74ea30a509df128fe98bf664 |
|
MD5 | 0f54a81d498672a9d9c18bc021b87bf9 |
|
BLAKE2b-256 | 6657834ce7dcdf75836ff9ddd9ac109643097f90487a9ddf90262a0afe5b4836 |
Close
Hashes for kgdata-6.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c573c056788f0b5fd1330292b15d5c5d83614f2d110bde1e163497951e7c3fd6 |
|
MD5 | 5c0fc658b6812c8096d23b00ee1f66fe |
|
BLAKE2b-256 | 1475aaf63b33b8be4568d70ae3142f42906e40879446a3627dfa20f6cd2920fd |
Close
Hashes for kgdata-6.2.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb05b6f7510621a240263c036fbebc7b654bd41c7c517f62eda987f8c4a8e10c |
|
MD5 | 92368be37d487aae73813d8ab6c7c2a7 |
|
BLAKE2b-256 | 55180ef06924f44c8622643290fd2f401b1604a474c164e28513130244741a1a |
Close
Hashes for kgdata-6.2.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eefb7a4a7ac36bdcd082e7cb15e41f2c96ce6fe70199efb02cef2f813ea34b50 |
|
MD5 | 175447db488ec4ccd4b00f5689570b02 |
|
BLAKE2b-256 | 94b0ed76c5a879d7d00b8843844001d1c4c578ab0d587bc865a97ebbb28d6a1c |
Close
Hashes for kgdata-6.2.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 65bf4e9ba6553ddda6f231b1ae91870242d9a9090fbd71cc9f09423bd39ddba1 |
|
MD5 | e3ffc7d0a061a36b08414b5ae815999b |
|
BLAKE2b-256 | 982c40ccdbbe584aefb5d1f7fa0c265883396f47222e288cb124353103e2ecb2 |
Close
Hashes for kgdata-6.2.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 400b0f6b69f3791622a4a65ace835f478f31834858ab4a2df6f49545f7e626f8 |
|
MD5 | 10040025ab7c3144523fb59bc7ddab33 |
|
BLAKE2b-256 | c0b16e8ab94b912acab12cba173a798e56f0761dd46e0b0233cdafd9fb679123 |
Close
Hashes for kgdata-6.2.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b1893840bd4582ffca8a9a4ad9f0a2298fdca2fd2b776277dbe4b91ed372deb6 |
|
MD5 | 6b15bbf2f89aced737a10b72ee784f48 |
|
BLAKE2b-256 | 8d7cbe2f08a7f50573b6c3d04b557f4b9506457b990e481732716743a39d1c80 |
Close
Hashes for kgdata-6.2.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d67c4219e8c103925fbfe3f1df9104c53b994e96849737cbbcf0f08890d88d8 |
|
MD5 | f8720950c0cee9fd98faa0171d99b52a |
|
BLAKE2b-256 | afb0bf50e9517f448cde82db3a373295f9ca3b2aa200cfb3290dd165fdf9c09b |
Close
Hashes for kgdata-6.2.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e771718a8046533e90de71b52a42eeee58b3844665852df31c3d27c9fceba18 |
|
MD5 | 98a3e1fcd73060351f934b2281af1426 |
|
BLAKE2b-256 | 735803df523ae30751da3685ddd4c6f09af8e8a0037d5bc342c326a36577e886 |
Close
Hashes for kgdata-6.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 09d00e2aada992183e4e3d2ebcfa5646a0c21373f84577a0c06bc68f52552f00 |
|
MD5 | 0f52be336c897c284f95432a2afa457d |
|
BLAKE2b-256 | 14b2bc2da548dcceebc951220d596640a53260dc83b605f05584f33eb8d5caa6 |
Close
Hashes for kgdata-6.2.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bbfbf8eb1018685928c590d88a1cb91ea907696c8e0deaa4552e7cb7abf180c |
|
MD5 | d5ef9cd8bc7ab62417539e47cb2643b7 |
|
BLAKE2b-256 | 32c64ab86a50fd396a65a2221c19677f3854e01991d5105d912582f0154a7a13 |