Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.0.1.tar.gz
(138.7 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.0.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 96637661509942d9020494c89b630e1949e63b25d43e32a5c2030b137d284255 |
|
MD5 | c4cb04154f7f67eb0be674a690652dfa |
|
BLAKE2b-256 | 5f9e56c00988b9c7e58d9dbd556de8f8739e698fa0b353120c53c0276709d4d8 |
Close
Hashes for kgdata-6.0.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b61e0a2eef582902fffecbef1a5b2c9f72788e8c5b3db6f62f7a0a712d35e72a |
|
MD5 | 78df332df9949c4f695104baa9f68762 |
|
BLAKE2b-256 | 17083a8e989ada97c6e0fe5b1a0717817cdb3ad9b322d9ce668f85abf7352270 |
Close
Hashes for kgdata-6.0.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12a80f6fe2a849b5dde27145c2cbe3da75ceeda8be352fdcb18fdd10a82d9bc6 |
|
MD5 | 2fdf74bb6e81c814ba9e1443f8944471 |
|
BLAKE2b-256 | f75ea29ed87317e024c238f5fa6d67e8fe8c966f3505cb3f9a6ad41208686157 |
Close
Hashes for kgdata-6.0.1-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c1a5d1d6b0869fbad0e9099f07881140259f12c5e8d0d662c325f2e8ab82407 |
|
MD5 | d03edf5f27a9f9a5dbb7b713ed84ea3b |
|
BLAKE2b-256 | 47050c9af1b46eb8aec0c72857862317a55ba51353422abe7ed1f4784c3724e7 |
Close
Hashes for kgdata-6.0.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4cc2968074b75cdd68272b4bbfc75e0d6bd19f8dbf4190b15564c75b8f360d83 |
|
MD5 | 112d0e82d65ebb5dfafa591c6c6ddbc4 |
|
BLAKE2b-256 | 3eb0392894e45fc377569948726acd12045f0e4aedc209e78567486ca540b014 |
Close
Hashes for kgdata-6.0.1-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d724a66d308a75fa93211aac67808d942a19a1496dbf6ffa83410eea7df1bb1 |
|
MD5 | 0de11a2a65e97626ec8d6c9dfcabe996 |
|
BLAKE2b-256 | c63157d5d97eec67e74577f6b510ce9e7da85fff78c523b03a3ec2f61634f10f |
Close
Hashes for kgdata-6.0.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 54ebdadf0a35b25c0a4bb5ecf19d33ed1e7fcecb9420a739b3e4ac2794f1167a |
|
MD5 | 4f3469324d1fef54b7c92a796ca0467a |
|
BLAKE2b-256 | 18800f36cf3774812320baedc8187f189611f4e35cec0684c1caec9e0c7a8434 |
Close
Hashes for kgdata-6.0.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67f9de7dc6470cb69c1b08d56073def211813b8b71e5b6937e2e8f43c6fdc477 |
|
MD5 | c8d26f6b9d9336a0e92ecc1a23ddfe15 |
|
BLAKE2b-256 | bf70957afe355287ef10ae95b7dc7d24d393722abc45198cde1c7c9745ca60d3 |
Close
Hashes for kgdata-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2b7a1cb801719cafbd2608cad90352a4d3bbbaab9f4a61c4830b44dc5b9518d |
|
MD5 | e157fb0f03f6b3c04fd0d0daac28a838 |
|
BLAKE2b-256 | 4e565a1e7f3e735586f6f6124087c9cd35ace298ca0ba2b3718d280c175a34ff |
Close
Hashes for kgdata-6.0.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6122a1c06f618bbe16f510d4fb6421c78a0783309d52f02e5074276a26ce420e |
|
MD5 | 9c27bbd7208e0dbdb6154ba5c4a1eeae |
|
BLAKE2b-256 | dc9404a0cd4e79874fe15b8b954ebcfc3ab8ad0270e8d7dc9cfed2af54c867cf |
Close
Hashes for kgdata-6.0.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b28415e7c44de1e3a68c25042f3f0f1eeaa4b1e4b7328cb23de20d62650d717c |
|
MD5 | 0ad0c9abb426ca4c53fcb3c7cc093225 |
|
BLAKE2b-256 | b73eeebd0e28dfb2589f798fd4201847289cfcd99f056dea42c922d2919dcac8 |
Close
Hashes for kgdata-6.0.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3114e6c71f330af9a0b3dcbe82cca05e7ed67accbb457b8d9162089ebfa425c7 |
|
MD5 | 5f898e6a4044bd5fb6362fc0612eb3a8 |
|
BLAKE2b-256 | 9e7048bf1deeb9460ed27d8ef2bf881574e9d11099d46d41e82775f2aec4a491 |
Close
Hashes for kgdata-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 95fbffceadf3b3c31038878b336a2a663b0bbc3ebe7a6cbb8cc29032830328c2 |
|
MD5 | 9946db507e9b3ef35680855ed122c8dc |
|
BLAKE2b-256 | 1ea0130242b4817666334db3859fdb1b8757b8a82a71977cb65c072acd1497ab |
Close
Hashes for kgdata-6.0.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ab550156d841ea12e07e2df768773f014f7d78ff58faa8882a6303ec3f1197a1 |
|
MD5 | 45054c7b3e1270e5fbe407a895fe85aa |
|
BLAKE2b-256 | c5e0d0552c19d790204a151d1a7d070014b41e312341af9cd6b56304fc2071c8 |
Close
Hashes for kgdata-6.0.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bcd828bd0e7f7535509b73fc1a49d392978f45fd7bddd1acd011eb355c934885 |
|
MD5 | dae3e10e469a5f30530b10bb03da0705 |
|
BLAKE2b-256 | d38eb30abda338701d94895a90a73c8ef5c7d3926b2166a7f3851e155cd76f10 |
Close
Hashes for kgdata-6.0.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a225aa7f0854025947bf1bff3d903d1176c849fb7c7baafb1f8f30deb9665569 |
|
MD5 | f20f864521eaf504b53be733f3575547 |
|
BLAKE2b-256 | c0fe756e5e7213b55095f1aef9cae13c2701787d6bf57b81cf43a2a809aa83a2 |
Close
Hashes for kgdata-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5bf3488b25b07f4c5fdd95fc666bb76359fd09d09de218e45fe8db11a455d301 |
|
MD5 | 0e9396bdedb62cea151ebfcd77a5501c |
|
BLAKE2b-256 | 293b68979fdade512fbdd4a3e0101d09f41ace39ca70f53c4a607a50a0b4b382 |
Close
Hashes for kgdata-6.0.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 66069ab7b6b2a10a9510e30e1353b11f173edf153243e54804b7a170b97ab7f9 |
|
MD5 | 6d89cd584f75156e6b1701c9587a7829 |
|
BLAKE2b-256 | 8bd5a2b80f169577a78ef2c6117876f5d5a16fe6ef839ac4d3eeaacc3b43a49c |