Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.5.1.tar.gz
(138.8 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.5.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5a945c99bee854590a8412ab7e43e676ce8fd26ff8bee908a11737bfae31e92c |
|
MD5 | 0de8bc4af1496388aacbaca78b783cea |
|
BLAKE2b-256 | 83ff9fd5f9ae46b3b6d07bd1e9bef0c4b698e8c946c9e525b118bbadf382d86e |
Close
Hashes for kgdata-5.5.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eb72fe5a01055c0ad275d3de4e2acc32cec1c9eb97eba579e8d3b6925cd58782 |
|
MD5 | 657736e0f31cffe86485e817a8d462c3 |
|
BLAKE2b-256 | 609ebff7f986d3268545b49f2ea921dacd217438d6e8d46568decc39bc920657 |
Close
Hashes for kgdata-5.5.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 48cc013e0c2a0970ac00d9456f7e854fb5ea7f0d67ab5060d608c4cd8d8f63eb |
|
MD5 | 8c7c979f9a9c19084a09a9b01bf31706 |
|
BLAKE2b-256 | 5066c4cc69b8f7430992b596682f0d8ebe9db4871fa916b73fa62a66df4158ea |
Close
Hashes for kgdata-5.5.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc5bc5b5e1b41637597f3c8538af9eeaf67c3b0732d3b8af26f3e2f6f11f3a93 |
|
MD5 | 7bef2c81db6a7607a5dad7b04cf93a1d |
|
BLAKE2b-256 | ebc8a0de55d0eb8bbb376d446c93f99a5c8b2644e859e89a5a6ee2ecafe58c9e |
Close
Hashes for kgdata-5.5.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 01c3e1cfeacaf17f9658250ab44a21e709da92c85bb564d0dfb04e16c50a9e22 |
|
MD5 | e71ce350dd23c2099d6c7593ef57ef7a |
|
BLAKE2b-256 | 52b318da8f68d02b1895a6114846ba1dccb31cbd859d99cd339aa5e45b413958 |
Close
Hashes for kgdata-5.5.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 986b359ede72badca5d28567d74013b8b0233ef42e59ceee7bbd62dbec74d639 |
|
MD5 | 5286d41dfa2e6054f7f632a06b894a3d |
|
BLAKE2b-256 | 1ff55cc9a26dd6d9b924b938e2825d8966160f53f250a007c7f6c9f28a5a17eb |
Close
Hashes for kgdata-5.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ecc894e0dabc531a723d22c8842862815bb97c0baec8315526c7bf4d48731c2 |
|
MD5 | 86b51b100bee9adb3d3a14416188ca14 |
|
BLAKE2b-256 | 7a8ca3106fa602fb425d73ad7fbbef0e7189262c1ba16eb1995fd821cd7d1135 |
Close
Hashes for kgdata-5.5.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ab0969996ecc6a612d28a3fb8e512494907d3ebf6504a7b8d4f2f1885af353a |
|
MD5 | 386d7d3304dfc1c6166a9e6f217ac48d |
|
BLAKE2b-256 | 1908ac64975e3a9e2a2426e7546a91d35b17253aec9723fc61a5d975b9cd5e6e |
Close
Hashes for kgdata-5.5.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 27c7bdd636ab6a6a4444079487677e0c7ee44b1630aaec7e93deb2319778266d |
|
MD5 | 2b793ecf2253682f0a8c86536b272a6c |
|
BLAKE2b-256 | 7860c8e8c5bc05ce69884b8a16d6a0b138da5d3863e889f96897cc44ebbb2b41 |
Close
Hashes for kgdata-5.5.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c52f7356a3951f70a2eb4e10d1faa95868ea796589b851ffbcfb9d7f6ac8a2d |
|
MD5 | 6e6ff380b8190ddefc3b0b48b403222f |
|
BLAKE2b-256 | 08c965a74e97645067385def2323879a599881bf47f2bdee9528546707953f98 |
Close
Hashes for kgdata-5.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5e8228627337b98fb4047b5a53b6d159ebccceef6aa3ff93eda55620f8551e3c |
|
MD5 | 8a3683b41870033de409562c712a6bcd |
|
BLAKE2b-256 | d549861724ba8caabde91314b1997c35877c084b02686fb9dcdf08d96f076adf |
Close
Hashes for kgdata-5.5.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3ff94c3b0b6e32f696a5aa5e704b2c202316de3616de94276c6a2bd06eec4699 |
|
MD5 | 986d8e6e93ef05c2dd189820f69c8aee |
|
BLAKE2b-256 | 873b394df86062d1b6edfab715168973f0425f6d5bb619af65e5260e1a883bf3 |
Close
Hashes for kgdata-5.5.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7b262ac182804755950e4f0164ca1ef26910bc601563adbf0083381a42920d18 |
|
MD5 | 0db95f9b1097d76a4bd46c3a374ce688 |
|
BLAKE2b-256 | 8b17a8d75ceed987e63ff98e6ed5aa1f60469f313f10ddabeb52bd04c08ddf00 |
Close
Hashes for kgdata-5.5.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 51c4601a73ffc8ab19b88aa67fa23486119da94c021f898e51963a9c114b4b2f |
|
MD5 | 5283bdbf7c3f1433bcfd2c39bdb7e70d |
|
BLAKE2b-256 | f1ce3af9f03ffb255632f6781edec209d837dca7beaa4e4891734699dcf24efa |
Close
Hashes for kgdata-5.5.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16a874067c1ad80d09fd9bb98e7d12975f6cb2dad18817692676b0bcf7a1e0b6 |
|
MD5 | 591c82849a86d8c6ba56f65726364dbc |
|
BLAKE2b-256 | 0fff2f4a453996a9a68af2e36e1c7311433a93d4c44ce5f677cca0c59313cadc |
Close
Hashes for kgdata-5.5.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 81f630285ed0744538624562d6fb3db725bd114458c6dab00bf2162d0860e871 |
|
MD5 | f48caf185a2fc0473508d77aff35e1a3 |
|
BLAKE2b-256 | f33f5828e97bc7e11d8b01260da277ecac188321ea8524eb04f9a84bf5f7ace3 |
Close
Hashes for kgdata-5.5.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d230a9dae37854d89f0006a524302482ee7b9b295bd1c80a05f61e9a722af80c |
|
MD5 | d269e0dcd775aad18d14d9f5865e45b2 |
|
BLAKE2b-256 | 3ae6afcdbcdbc2f39d7adc4a3e9c189da37ee284368bb0cc09a63b0885efdf9c |
Close
Hashes for kgdata-5.5.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f1531e9e156831afd18818980885c734d804c69db1c00271fe35975a641fd125 |
|
MD5 | c815004788c6e59e125fb912d8fcfaea |
|
BLAKE2b-256 | 75a3dfdb3bc12a0337b1dbaacbe5b2bfbee3ce173a1c949268f73bb4e4e72d9f |
Close
Hashes for kgdata-5.5.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fe0bd66aaa8034165161630af94514bff608c3fd35d4db7b983893c45ec67c0d |
|
MD5 | 0078e5719a85eb1de907d9bf6723113d |
|
BLAKE2b-256 | 121800bee76b22af88727131217dc23e1a38ff5aa2d95a3aa76d4749d46d79b5 |
Close
Hashes for kgdata-5.5.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1f7b5c370ba48c2130911e236c2610998b7693dad8e98b89d56f4871b5b5def7 |
|
MD5 | 87e16c572105c67e5a8d9e19fe9456db |
|
BLAKE2b-256 | fe5c51546f58a38dc3bd99cdc2f76ddeda585d97c35bf204ab4c14a2c1c568a5 |