Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.0.0a8.tar.gz
(120.9 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.0.0a8-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 25f236f0bee46bad4855d6e7335035edaef5aa27be8ac876dd2ba0ee5ed5f0a4 |
|
MD5 | cf00ca94a30e9ee9dafbd34ac1e4aaee |
|
BLAKE2b-256 | c74cff02e2a8cfc0eab18ae63176cc0f023fb0b079e30a332ffa1644721294dc |
Close
Hashes for kgdata-5.0.0a8-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 89e9215c99cefdb28df98fff5731de61964535a822aaf0a649e42dc888ac5576 |
|
MD5 | 77d4c3852427acbbbef221710effa4aa |
|
BLAKE2b-256 | 8d00255ce66c3c8a6cce95a2a1e66a41350bd659962e219638f770945aecb612 |
Close
Hashes for kgdata-5.0.0a8-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 871a9b60da0c437ea1a82600efce8dd5ea3193dce828660ee38fc3aa67289b33 |
|
MD5 | 4f8750965bb3931b5276fba7307cb149 |
|
BLAKE2b-256 | 34d1b29e801561845a959bb9b8aca628f6681102570d71c915f079ef2b344aab |
Close
Hashes for kgdata-5.0.0a8-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c4e68bd261c4800eb56112ab144357f1ac451ba1c05a5bccda9048d23a6a413 |
|
MD5 | 2588de95e7c7360bef74037f3d933f8c |
|
BLAKE2b-256 | f33bb28f35d9022ae218c1721d24e1e18dceb40a470952c3f31d8748d77917c3 |
Close
Hashes for kgdata-5.0.0a8-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 86bd7655cf932bf1b3243581ef88790a2832bd6939865acd575663481e85d4bd |
|
MD5 | bb52f0433d6dd85149737441eb739967 |
|
BLAKE2b-256 | 70fdab5a9438bc32274132a0c2c902932494d520d13d6ec8ba1034d57d85d3e9 |
Close
Hashes for kgdata-5.0.0a8-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a17e70b178b195cbda7b576ce5b7ef727daad5052be1a9b50e22da386e7847b3 |
|
MD5 | 64c6ae68353ce7eb91c934f7a2e61f7f |
|
BLAKE2b-256 | c6e2bea04d5211fc87e59240dddfaf9e48719d9816f57cfda5aa7b117397240a |
Close
Hashes for kgdata-5.0.0a8-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f7ee65595f1097f78db4fd9d88bf3da6322d00cdb7a27d6141bfeca2854097f7 |
|
MD5 | be0650f535bdcf262b0b7ce19365d2af |
|
BLAKE2b-256 | 30925ad4857a918c0eeb5b4cf84822210136a67ff460c6b852eae91399740f51 |
Close
Hashes for kgdata-5.0.0a8-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dda535bef2948637ad3dd2594ae530b56743b5325a24e3387f9a9d48c1b17ab3 |
|
MD5 | a4d1742a14a7bade94d084942f7e6d33 |
|
BLAKE2b-256 | 1f2da6d49d6343825bae5b6290aa836489b76108c830bdd96faf1f49e3e06221 |
Close
Hashes for kgdata-5.0.0a8-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d859c8e1e010c45569e33482eec33e681154f6c8d7728301f863065707b1f1a |
|
MD5 | ad6be1a4245b03f8dd7c2558beff9073 |
|
BLAKE2b-256 | 787d6bbe05a5a6b3ee3726b187c184b51076053ff2d39ce7c2ab4e610bbbbf62 |
Close
Hashes for kgdata-5.0.0a8-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 36b07906b5d687d1241ed65b8ce527ec6235bde7e8863ec1559f719f0adaf11f |
|
MD5 | d6db59ea5e8ba9782a8807e9b50429a4 |
|
BLAKE2b-256 | 00cb942ba9ca00f9be6abef443513a8d10b953107f04dd46c8a37a951cb06167 |
Close
Hashes for kgdata-5.0.0a8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 711377143574293bf92bf2da0bfe7a2ab78f971578fd9ec0e9567f9fa484848a |
|
MD5 | bfeeff8d1d6d291e425143448109adb5 |
|
BLAKE2b-256 | a6acd6b60e4550fb182c3e0ced6e93181d9d79b45ce35796332f201d206b6d74 |
Close
Hashes for kgdata-5.0.0a8-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bba2ab90b583e20a5c59d49b32b0cb64e3a9271a61eda19bf114f0fc1846bf60 |
|
MD5 | 368403308c6ef5a0f6af89c9aedf5363 |
|
BLAKE2b-256 | b83bb976da086d36fb37d6aa16cc0f48413e498ee029084ac8e405fd33580221 |
Close
Hashes for kgdata-5.0.0a8-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ea554b6d6b2bdf849a1827f9af5456896b8dea7f7b0358e2548c765ee0f3a0d2 |
|
MD5 | d66682dcf6baa76c088a004b3fa32824 |
|
BLAKE2b-256 | ca08ba4ff1a6f7e502f51c1617cadc57982a695a7859d3fe5256e8a9efd0a05c |
Close
Hashes for kgdata-5.0.0a8-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7398c5dcb7d992462e3a22f25ffb383c0fcaa5a9d09315d1d69f3467d2c512e |
|
MD5 | 8d86cce73d238a4c8fda4bae3169f2b0 |
|
BLAKE2b-256 | 30d5938aaf42c3b8958a8289c08733c4a0a84d8a561ec3ee857b605804fb65ef |
Close
Hashes for kgdata-5.0.0a8-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0b4013ba408ea9aa94fff737ad12f79c964a54db59a5ea52dd7a32a3a978f2eb |
|
MD5 | d1aef6a8e427630ffbe9200e2c41acc4 |
|
BLAKE2b-256 | 3735e16b9b084db3a9db4ff625c0b7b0ddbb04e3d045a797a961b20c372d4ecb |
Close
Hashes for kgdata-5.0.0a8-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e69e6391f33e18e84428132a1744bc5a953a78336a8252ab001d90341651378 |
|
MD5 | 5e9627d546d0628bd327cc0ae0f8c3b4 |
|
BLAKE2b-256 | ae423e57b510f8004bea5bbe6e78a80b984739d42de7eb94ac4c00a8d7f4bcd8 |
Close
Hashes for kgdata-5.0.0a8-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d83eb6a224402709e15cc17da02b8f7e5988bd342979cc621c6f9e975b48a6e |
|
MD5 | ca7abe95b7a9048d3c942380136a96c8 |
|
BLAKE2b-256 | 074f1aea820fba08d4f7fde9ea5301769d4aaf9fec6219525245b7c77bc2c28d |
Close
Hashes for kgdata-5.0.0a8-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fcd85e2a7bb9436000ac5cdc11b459acd100cde922e52ac4e71d4fee894a9ac1 |
|
MD5 | 83895679f0bfcec48691cc75d12e3fd4 |
|
BLAKE2b-256 | 76d494075e823c5d0151e4a180cc96a083ad1895c752092d165275683207709c |
Close
Hashes for kgdata-5.0.0a8-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ab8a3f5c36e7ec26130ba69c18fbb20cd92fa27b1517a5bc234f2a9b2b916eaa |
|
MD5 | 30c112bf086964c5182fd16a700a85ab |
|
BLAKE2b-256 | b7ded05d3f2316ea0eb0350d85c0cfa6d9ec7ee4eac2ccf1fc15da261b13fd7c |
Close
Hashes for kgdata-5.0.0a8-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2ddaf5551dbea130343f694704851a0fec38380898cf21325a2cc856b9308621 |
|
MD5 | 877d262afcbecc75e914c139945c3f94 |
|
BLAKE2b-256 | 234c1a5aa8c88cf74f1e22d58e9ed7499dfc52d3ca8dc0d87997339a6dc070ef |