Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.0.0a6.tar.gz
(120.2 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.0.0a6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8524fc074d3e76e92ba2a7617f1bef6d3dc357cc566c9661c75e7229e2aa024b |
|
MD5 | 308243d4df02f157fb1b5c414612976e |
|
BLAKE2b-256 | 6598cb7f416334dce606d64eb39eacfb33646506cc1c0ea10a0962390a0738c8 |
Close
Hashes for kgdata-5.0.0a6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5257592c304ded62b415e2f37790cdee0e4a60e541b3c3b6360612f7c81660a2 |
|
MD5 | f74308e254c32131154281074ae34e6e |
|
BLAKE2b-256 | d1baef512481103577458538ecb7dfead666124c383336fa1a41845fdf25c429 |
Close
Hashes for kgdata-5.0.0a6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 32ce6d7e53ac5d4ad18e23dbd79674de9e10849ebcf7bf45c3c10d01eb336e62 |
|
MD5 | 68214123d5517fc5f0f379bb9a081115 |
|
BLAKE2b-256 | 7422e89da2ae62bb0b2898ac7d3709e93b561a396edaf84d5de820e780cda2f3 |
Close
Hashes for kgdata-5.0.0a6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 189f7ed16c056291e1e263b4411d0ae77354ddb80c2ae9dce2bc83e26fd750aa |
|
MD5 | c8a0e7c364d368953bf4ac2dbafc9ed3 |
|
BLAKE2b-256 | ecc87ca94b9339da363d102d32cc5f1ac2858530cf374cc17c8cb5b8e914e951 |
Close
Hashes for kgdata-5.0.0a6-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83010dce766fb173c104db0b665c3bf664e32f3ef6ec9f9f27d231c9feb3475d |
|
MD5 | 8cc603c50657fab596904fb2acf00dbc |
|
BLAKE2b-256 | ef28f6ff58ed060ffdd174ce26a4db76cf70232a12e739a1b6f45bebe9686c9c |
Close
Hashes for kgdata-5.0.0a6-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9f80d5ea55f39f55a340142937dd8466ef87db5f2453b10b6ed7e69ba77aab5 |
|
MD5 | 76e3978c1b5ac27199f4d2a6dfd3d98f |
|
BLAKE2b-256 | 150f279ab04c558e26e644964eb02e93f5adc4f11f7f57eee9676a5fd5f873e2 |
Close
Hashes for kgdata-5.0.0a6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5cba0cc596732ec6f8973f7e2ce2ceb4d7941e97bf92d95405e0ea7c29847aa1 |
|
MD5 | ed994fbd358970a80086387dbebb72a4 |
|
BLAKE2b-256 | 0f739f68863ddf6d8a00962b363ca4062a865f951afca597836887e937c91fa4 |
Close
Hashes for kgdata-5.0.0a6-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 43331f5efbdf83888e375f97040c8d8e613e2b54f444013e1027cce3e5ad981d |
|
MD5 | 4832658b21bcf8a1156243cc4a027763 |
|
BLAKE2b-256 | 8be6e054218350bd1233186efd17b3f344c3f9b666201d056092e633f5e9f6ad |
Close
Hashes for kgdata-5.0.0a6-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b68cd15a03857cf056005468e779057ab56bb87508e72c29f91cf39abde1d2ef |
|
MD5 | 095f949a566b7c2ef8d11bec8ee5de20 |
|
BLAKE2b-256 | d1c2504b19c065a836d3fe3b72709002fb0788fd055172e47cc327624b805e07 |
Close
Hashes for kgdata-5.0.0a6-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f8eece97ffd259309797b581279e0bf0681c52b2f037d7bf5c75bb9a333c1799 |
|
MD5 | 9d955d5187866cf6d6c3ed7b6ed1cee1 |
|
BLAKE2b-256 | 996bf49b1b9eec5053a4d6dd632db80528b0ce6e4964545ad89c318d1f5004b1 |
Close
Hashes for kgdata-5.0.0a6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 768bddf47349160e9860c4c45dc7a75413b9d91e8cb21427d3bbfc57b9d68e35 |
|
MD5 | 6ad469ca32995aff507dc7db91da8c0b |
|
BLAKE2b-256 | 68fcca176fdba89feade014b62263266e7145de3889db19834489938b559b329 |
Close
Hashes for kgdata-5.0.0a6-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39e2c8cee567bfc955f4b81cd3de755baf7a30b71c3a7278a25f33ad1d0c901a |
|
MD5 | fc782a910a51c5c1eca466202b9a914e |
|
BLAKE2b-256 | 9b86833dd519c83a55cffddf9da04e8ff0e7420ba621696b817515267909a6d4 |
Close
Hashes for kgdata-5.0.0a6-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba7f3dc374dcd8b5524b836a65d71f075a34f6832e0c6dbfb3d8c72dab0df806 |
|
MD5 | 2af352866f16d7b07f4ae9d69785ed15 |
|
BLAKE2b-256 | df124aaa0d5674d3473622d05184bec94aca843e780f3c71e118fca7a86d1ca4 |
Close
Hashes for kgdata-5.0.0a6-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 461fe3134897c0a6d5b3f01a59602bedb5151811d0fac0d4f621763b08f9036b |
|
MD5 | 586e341ee5d43c7ee125292e39584d1b |
|
BLAKE2b-256 | 21feef30fc9bddd169803325803cf7a3794a730f928fb423770a6ff8ecca9875 |
Close
Hashes for kgdata-5.0.0a6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2948c9a1137bbf28e6291813ad38c38b85c365339ac09e96e6426ca34ba2b4d8 |
|
MD5 | fb4d67ebcd86513915341070cbe5f439 |
|
BLAKE2b-256 | e8c34238a20c8312bf2cc39855cbfe3d5c352b8995f26096b9eb0888b45885ab |
Close
Hashes for kgdata-5.0.0a6-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8cf349fda53ecd75da65f97d944e8d18a4c69e3368b957c2d62c66f3218a4ca7 |
|
MD5 | d46e444538808125169233301eb3091b |
|
BLAKE2b-256 | a138e4c2fca1803070067baefe7adeaa2d7ce3ed1ef909c3352bd7e4437eebb6 |
Close
Hashes for kgdata-5.0.0a6-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3ce2d3cff54b3a9ff71caf484ab23005aed7bece13bf172bb7a4965a330d170d |
|
MD5 | 351b56aea3309a45353d9ae908607249 |
|
BLAKE2b-256 | a04f32e003631745899d762a925063b9a435b645e86e9bca0c6225ebc48b177a |
Close
Hashes for kgdata-5.0.0a6-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 057cb014d97f7ebcfccd12fd34f07c8dd9dd84c77081809bf9b68f3baa236d65 |
|
MD5 | fbe1c690f6fe951cd0beb0d8595e72ff |
|
BLAKE2b-256 | 1677157605a69cff504e54483901850f22dffce2d56807cc99e99a20d2143ede |
Close
Hashes for kgdata-5.0.0a6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b323049cc7f2b1a8adc1cd362ee1fcc1f91d0088984a1b2f8d065c649436e6f4 |
|
MD5 | 45080f2090905155c2ae2c999b3deabb |
|
BLAKE2b-256 | 874d4584caad7b6aed9653acac3545c4f6826d59774843b015a9ac4d7cf00779 |
Close
Hashes for kgdata-5.0.0a6-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5db74803af0acaee80d7a92996116544c76b44b956b2cc41f8137338effd63ff |
|
MD5 | ed596782b14b4082b513f8e3431dc1fd |
|
BLAKE2b-256 | ac79a8370f1c8eaf4beb9ef507c746d84264b78103931a4772bd38295f1a5960 |