Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.0.3.tar.gz
(110.5 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.0.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 47aabc939b8b9f0b9049cdb9ca73555bbd1b3f5c600f5b7a658cb7fe5a9e53a7 |
|
MD5 | bdc5ad24912502b6f9115877f5a29b6e |
|
BLAKE2b-256 | 3f19c2c7c56dd1de8052e788f7f45ca88aca77c0e757b917b2e1638f7251595e |
Close
Hashes for kgdata-4.0.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 14e8f99d957405f2ea0ae908ffcf85ebe6892cac21fc2853c2dae9760d9e9f2e |
|
MD5 | 3bbe82175217297f4e6e5e8fffb0ec4d |
|
BLAKE2b-256 | 98eacfbfa3f91739db6fb55bd381fb36f7772f9e6f5e81491e9ae312e154a4e0 |
Close
Hashes for kgdata-4.0.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d02ad686dcbb1d79918ac12c52ee64930a2d2e07d5eff786686d1c6860412fa3 |
|
MD5 | cc0e5560c6eb70e176a7171d0118eb89 |
|
BLAKE2b-256 | 630c20c3f635c93087f95bd4a4d116375c1ea20a4d51e41e9c947446c857bbce |
Close
Hashes for kgdata-4.0.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a77141c2d4063161edd81c841bf096f172f4c46f237535f1b38af561a80609d |
|
MD5 | 15874140c9d32afc666abf9fc7725c3c |
|
BLAKE2b-256 | 0b7cf35566a1440eeed9bab81439fa0d726b3ef972e36a6c1b08ecdeef3ced4a |
Close
Hashes for kgdata-4.0.3-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 242fedc915afa04f2178c531d44b8dba4733bbdca1e92cb927c28aecf21bfac2 |
|
MD5 | 70a4bcaba9ba7ae3fc0ff253997f85c7 |
|
BLAKE2b-256 | 536852b171b9e7a95ef770907d50b20a510610ad3fb62fdefa515e6b901b9b95 |
Close
Hashes for kgdata-4.0.3-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 348ddc5cd78f28ec4742a494548be491eff27017ccc8a92687e8efd182be43d1 |
|
MD5 | 12ea1e0b95f538bf42b1f4d7fae1979d |
|
BLAKE2b-256 | db501d69ce0f305d76ebaca0315ceebae51de17925cfbf54775f8fd5c9f36788 |
Close
Hashes for kgdata-4.0.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 446737e89c9efc4a951c284558ddf000123b87a71ed0948166613558228f9a63 |
|
MD5 | 1317c6c2e4d5272370a32744ff672055 |
|
BLAKE2b-256 | e79c70c2aeea33bcf8df4f937c54d0b2d8d05183417d7fc8e3cba0a3af94e6b7 |
Close
Hashes for kgdata-4.0.3-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cbc008751de11a2512c2e11ff79ea843a8e0d5e9b82c3a4a10bb6ab832cae924 |
|
MD5 | 99eb910a786aa43b68d31d4721960830 |
|
BLAKE2b-256 | b56a171b7edc9ebec6859c700c8efe605cdb5d3d926ec91433ccd20d4c5d2ef4 |
Close
Hashes for kgdata-4.0.3-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 906cb9c7c2b393b6e3789e23f6695f583143bebf9245423d59bc186a05a3b802 |
|
MD5 | 0beaceec140be128e83e0e3ae8af67ff |
|
BLAKE2b-256 | cde8a8a6412cc9fd89d3db3c1d1061026ae7131caf895af1dcfb2df3fc54c3d5 |
Close
Hashes for kgdata-4.0.3-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 048c18bdc942f43f6ced402bbddd1f947d219786cd8ad1d8c4ee4a180d958756 |
|
MD5 | 73e7e99d5d4fab93744bad316720f5b7 |
|
BLAKE2b-256 | 4ca9aa984b846c3aabda8c7db993d90ede46eb5d6a69e985a3055b26911028d7 |
Close
Hashes for kgdata-4.0.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc5cc4bd98cb816a2aba36241dbe7cd299a2671eeeb060bd16e6ad0032e2f2d0 |
|
MD5 | fa1893f62ce7acbee902ad676b810834 |
|
BLAKE2b-256 | 9aa6eb44ccc4d52035761525fbd45d456c070364bef56c76999ec2ff1e8a94c9 |
Close
Hashes for kgdata-4.0.3-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2966bb9669b5814ad0afc187f92394277f7c8d3399429189c9d9d12d5fa10e8 |
|
MD5 | e2d970e7be7302955ef33c58d18ba0fd |
|
BLAKE2b-256 | 1d5b2850d332bcd0cc66e072a4930d030cd17aa5860b8626465296c15ace8b8d |
Close
Hashes for kgdata-4.0.3-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f1f5d9cf3b5d0d79099800b931a3bb1e1c423022b24a53433d6c376c32239e2 |
|
MD5 | a4514da9b72efe1949de1a5d22b5cf8f |
|
BLAKE2b-256 | b41c58dffdbcefe1e6d24fc7c828710eba2be75e1a395baaed9f28846a7ba01d |
Close
Hashes for kgdata-4.0.3-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 53acb104a0fba286a7f95f084a421a8e16269c6e43e7a0a2ddfa193f0b8f482c |
|
MD5 | f6c8da13999d253fac742e9a58e1e5e3 |
|
BLAKE2b-256 | 159283a2641bfcad86c111d65f6b3782e28488c30cc36a91359c8b91dd1944a9 |
Close
Hashes for kgdata-4.0.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5ba39af6af59f1f355e5a7d4b6e67d82d9ceb4e0a93ff0f1b9819e04ce613e1e |
|
MD5 | 83d273eb6530b7eb635718c4f12f4d60 |
|
BLAKE2b-256 | b770b0699a60ed97ef534885e6599ea3594626a69d25981e0dfdfa01b7c6cfea |
Close
Hashes for kgdata-4.0.3-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0b69e9c07ceba52506dff9f2151d07a7c4c3a3ecd272d601528dc90ffaef8cb1 |
|
MD5 | 9dfb7d686dfd465bdca828d5cd527613 |
|
BLAKE2b-256 | 923cc7b309814ab30cc12cae0068fd4c0165aa3aa885abb13725c0e28399e7fa |
Close
Hashes for kgdata-4.0.3-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 100390c66c4d5b09721eb7dd66fd63229bc8599d3da242b9eb5ad0306eefe92f |
|
MD5 | 90463651b15b08642b30e93defe055db |
|
BLAKE2b-256 | db7acf52545824ec147727384e15d225cf9ec807b62640e0e860f1c2dd7ca517 |
Close
Hashes for kgdata-4.0.3-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 87ee9d0702de4d2561cdbdcdaa8ba540cfd7122d0c1b05c4f565bc13dce3ae65 |
|
MD5 | 4bf925f6e7359b10522126ba053b1607 |
|
BLAKE2b-256 | bbc48dd4829e8aae53097506139e3b83234b8be8741db3c9ed07ed9df0d01877 |
Close
Hashes for kgdata-4.0.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 11faf69f4ef7c0bf6122416e67092af1c1d3b5b9f23f95af3a63d3584a04c755 |
|
MD5 | fc7b4378f22ae71635f54726fb00bbdd |
|
BLAKE2b-256 | feca7f0a0e12114e961379fd6258f844b26dd43c33704605d1ddc224b57cf737 |
Close
Hashes for kgdata-4.0.3-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fc018c1ff0ab7598fde463517a7b4aeeec25850cf134390bf53c31751a40ed22 |
|
MD5 | a61b59cda12cdcf47f2ba15eabd1ea26 |
|
BLAKE2b-256 | bf998fa5be17ea05b679fb7aa89483b8c89f15c90b6d7db557afc75d7943d012 |