Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.2.1.tar.gz
(123.8 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.2.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 16fc45afe7ef2b678f2c35f1e1bd82f415a3f52a543884e87e1b01436643ad19 |
|
MD5 | 8e8608b0d9b0e0a0f506e80cbe380b06 |
|
BLAKE2b-256 | 639b8206ccf3acee2af26f0d7c816a4785840d53c3d367ff3e539be50189bd3a |
Close
Hashes for kgdata-5.2.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1659c5510dba074a9ea105a2b5c44a03c34f8dee04801166662911b148cc77b6 |
|
MD5 | 0c19eca722fc76479e88627f2bb8d2be |
|
BLAKE2b-256 | 2529f392f45a26d49dbfa2e7ad3c2f82cca45de7e71109145d6dd1715cb4a0a3 |
Close
Hashes for kgdata-5.2.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37a52c94ecde76b3903de6c665feb7298c2beb2564282a8f27502a4c585f93cb |
|
MD5 | a0a53160d81590f85af8e7db3d4d400d |
|
BLAKE2b-256 | 78d1f4103c3981ff2e9446c0f5312d0f3fafd3e3cdf8ef7deba421d83c704af7 |
Close
Hashes for kgdata-5.2.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c8461bb25f4d51980db0ade4b84f1594193b8bad8d3b8becd4d9f4150120de51 |
|
MD5 | 3e2f60e511bd21cf244befeb59bc3044 |
|
BLAKE2b-256 | 59ec96b657e10bf5d816968f89b6326702e704ebad7582b22205c4f0fa6b21b9 |
Close
Hashes for kgdata-5.2.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 343bf609c0a53e5d5fc9976322bbe4e1342fadeaa239a24b9f4563894483c823 |
|
MD5 | b946741995094675bbd11fffe8c8c0d2 |
|
BLAKE2b-256 | 0671705730f692eddd9cd6afbbf08a94af967d53ab533e9b6be1d9e3498d3db0 |
Close
Hashes for kgdata-5.2.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40bf8b4a474ca1f8d6c61313aad2c2052bc5529aa0766e8ca97447387e20860b |
|
MD5 | f9ce0bc360ca2075519102e598571d27 |
|
BLAKE2b-256 | d13fdd73acc4afd9a666aa385b6e5e143d13b976ca8695d4ca2b44f0e4b24a28 |
Close
Hashes for kgdata-5.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7560c8d434cc6cda2cdb45ef498128a3ba944ce28ad645487413f8ad196d3637 |
|
MD5 | 428be2352fddb339c11c665ebeb5e98f |
|
BLAKE2b-256 | fd381f737b05bc9cb22f1ad9e5b99a4628aa9d01ddb20dda891397a8c806214e |
Close
Hashes for kgdata-5.2.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e753232d5fc872e786199d2975397356762c4ff93254e8cd4ffed17692fad46 |
|
MD5 | 33f0f1948302a5c9115badfc7808b2bb |
|
BLAKE2b-256 | d23ce5add217550b9339a38957c7a8a9c9af88f4ae7bc07d7e3eeac7e4ff9ac6 |
Close
Hashes for kgdata-5.2.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 254166d3c9844aa6cc3ed8800a2c4a30259e37a154efb294f13fa69949785d51 |
|
MD5 | 20ed8b962b47b9c5bd4fe48a10936361 |
|
BLAKE2b-256 | 0cbeaa56811f88354dbaaf1c4be1284379f6dac2bc265aca9b8298caa1d16406 |
Close
Hashes for kgdata-5.2.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9188157171212d1217ec7d1b33141e7d0c3accee3d232186769c74ae70b23515 |
|
MD5 | 85f1ab1a45e0cbc12eceff38a48af67b |
|
BLAKE2b-256 | be7e2dcf1a38c37cda0cf5f828bb9489c5f43fd46efa0059b019719f15586195 |
Close
Hashes for kgdata-5.2.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7f2befa691a65c2df454682c0fb38d00d00bff5a2a4d049c3e04833eedf246cd |
|
MD5 | 8790f4337171c46cf9826070cbcd623f |
|
BLAKE2b-256 | c1ea2f1ba7e74c2fd27b523aaeac1455ea49242be700c3c7825bde68f4149088 |
Close
Hashes for kgdata-5.2.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c937374a9e383e5901af45a52a3beab322d597ae0bf4aa950ef019b86f14835 |
|
MD5 | ade2838794e429df9c93d382e9837f2b |
|
BLAKE2b-256 | e367787034ed5fcd45b52149769ee82aa026e191fc83d08410ea7c89fa7021c8 |
Close
Hashes for kgdata-5.2.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | daaad841e32238f17e3dccca735a864f64a00bc462c1624bc8224e1625a4ffcb |
|
MD5 | 03f181fdcb9539c40e2c411143220636 |
|
BLAKE2b-256 | bbf9f218547a4672f317a64c723524f249854338a8127e9bb129437a61630427 |
Close
Hashes for kgdata-5.2.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f40094661a2bbfb593455236897ccac65364269887223f2b1f3998b3132025a6 |
|
MD5 | 96a2cf337e76ebc450d8a688e429a0fe |
|
BLAKE2b-256 | 5cdfb89c357b1c159e7d78bf73436731bcd1c4497a5085d021cf7b8ebd677750 |
Close
Hashes for kgdata-5.2.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c989e0609ef591e6fd85eb9864b70d097b39b7b0804bffd67186240a3b09c57 |
|
MD5 | 1ff224a0f7cb7f94f230c45a10c3d3c4 |
|
BLAKE2b-256 | cd61e83694b5be602eec173710b0d9885bad6f22424453a11f6b86ec5b91e035 |
Close
Hashes for kgdata-5.2.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ec24e3689f91471601e4100852d2796c7feb9e97e82acdc22416d6ab8f31babd |
|
MD5 | aa71f0697fcb480cbc28c3bc8a4059db |
|
BLAKE2b-256 | 8e86db728cb94e45f45bcd1e651b49ef7aa51ad34fdb5f8172e4197f2bc0fb00 |
Close
Hashes for kgdata-5.2.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 177b454207d319dfcc6273b3f6f430f6324201363c5471dd93edab35b6092845 |
|
MD5 | 95a667e7b952cf828d8664d9ba97dc0f |
|
BLAKE2b-256 | 2da529c56509320f6f2efcca9568a996c73973395c6952e52acfbefc828da919 |
Close
Hashes for kgdata-5.2.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b76dd428abcf29c42e965d3dafff1e7b50fea0558b8f1087918136e7e50d512 |
|
MD5 | e99eaa509dba6ff40729a5504cc4032d |
|
BLAKE2b-256 | c43b7113214154d09d069068388ce6e9e220f3dd48ea82303afd8a5a2d87f9f5 |
Close
Hashes for kgdata-5.2.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d57b83d561c0ea6c486b35051c271086c085680482842f9ae2d1a0327f199d9 |
|
MD5 | cfbb2b74193e0df1cf932d2290a0264c |
|
BLAKE2b-256 | 76d00606b765bff7ea7c8d22398ae644826c5b65b73752997d868bcefa55bde9 |
Close
Hashes for kgdata-5.2.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 300e40b5102910a65b2b920ab4b2ef0ef0962887254fb784e3dc77216c68259a |
|
MD5 | 9010a81a8720ff53c122d0461b5ff1d2 |
|
BLAKE2b-256 | 00d771dfe7b5e0d981ef15409b0083f7fbcbe9983f17b5542f9542681c2180a0 |