Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.0.6.tar.gz
(109.2 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.0.6-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61328a7e873c8244dc9acb4b6aa95742357ad82c9a0ea95bdec4d879cbb36222 |
|
MD5 | 956a5b8a3a97480d0cbf4145a2226065 |
|
BLAKE2b-256 | b866f82187f3dae0fbc7d05d9420f63a87c3b5365965c0593054ab9e9d5f83cc |
Close
Hashes for kgdata-4.0.6-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fcc4ab9388b8bf0dd7334aec9862e9bc75e39fdd202cda288c3b6c052e9587eb |
|
MD5 | d3046ff49d15b2032cbf5a55068db142 |
|
BLAKE2b-256 | a03b97b26185fd20a8de5141e764ee4bff902c1a79c71da3682f6aaf1f5020d9 |
Close
Hashes for kgdata-4.0.6-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b16939e351693bbae613626af2451dfaae9d0c74a15b23b36918dbb67d8381b1 |
|
MD5 | 9600a5f8d5ef384c5c27482f3f79d752 |
|
BLAKE2b-256 | bd4f055f80321ba1f747642344dcd2accaadc731dff48fc8776333b108524d0b |
Close
Hashes for kgdata-4.0.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2d05b47cdfaa1476bc551ccfc91fdfc37a80d6111f60e8d83e3e36886127905 |
|
MD5 | ecfec360d5559df4a0e315050199c6e1 |
|
BLAKE2b-256 | d4d834bffa9e47816845cf3cdb10c82bdbb32f83aeab1a52bbc599dd2b91e8b9 |
Close
Hashes for kgdata-4.0.6-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 623324e059cfc8c74d9d74dc2976f0760edebc31da29966beaf73dcc8c9cdafd |
|
MD5 | a0ddd0b19c9b108abfa6bdb90ffba79b |
|
BLAKE2b-256 | 16f2622958dfa661fbcaf485ede71a967bb203fe17b51e35375b3b1791109071 |
Close
Hashes for kgdata-4.0.6-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a49fb6f6945283c087fbbe35a9edc661a0dd24915cd01392ff32070105aa228 |
|
MD5 | acbfb271c7a80917acfa68b19d2aded7 |
|
BLAKE2b-256 | c9644065f37bab1ff5c24ce4dfcb8b475d482375a8dff89d38f2b381974c410d |
Close
Hashes for kgdata-4.0.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c53ae65f8d79416f672d8608c2cf8e95d38d01cec7c2dc91f842dd3195fdc42d |
|
MD5 | afb13994fda2300fd22de67f1ab1ed34 |
|
BLAKE2b-256 | 3e4fa2ca80c91595edfe6736d85616d8f86f756df7839e17425e43cf16077987 |
Close
Hashes for kgdata-4.0.6-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 13fa3d189edbe90e10b3928c26bf2e47a77d9ca0d4aa9874960a33249c2e49c1 |
|
MD5 | 8dd9df63e5f7045dd78fd1da6dbece49 |
|
BLAKE2b-256 | e7a6d6da6a1a2713663526bf54809917852da065b201c46a19aec4063e738698 |
Close
Hashes for kgdata-4.0.6-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d26d641bf7df2230c79c0c7d6768a58dc14f08d7ef94d64bf4fd9f0f7a54495 |
|
MD5 | ca82baa490e0271168845b21beac044b |
|
BLAKE2b-256 | 23d780c04ad19c812e7bd80748cb06e1f1a2540fcc5e93565b8b57474e24867c |
Close
Hashes for kgdata-4.0.6-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9706c41388b3a256ba2df6b7ea470e7bf0dba54577874632a335559b3610fa2b |
|
MD5 | 9a4b089145c9ba3057d309c8b7f32a64 |
|
BLAKE2b-256 | 33a11d8d2ea0f5814ae0b407be27d64cd2ed1cfabf7dc8203f84d62f0012323a |
Close
Hashes for kgdata-4.0.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0de4097adb33b1ff83ff08bc3f6d6851b424e20ca5907ce5d6a7bbdf90e756ce |
|
MD5 | f8404df9e0cf7cee2d2b5a9c3fb1d92e |
|
BLAKE2b-256 | db22d8c36903310b8d44900d9124cfbee5504baa996e58bd9658cec025b91de4 |
Close
Hashes for kgdata-4.0.6-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c5a2b5797c5893b6a8af7f8f4be717551554ec6f6abcc50d367d560083c33b9b |
|
MD5 | fe3ab20a7a222801bfd0aaa48daeb38d |
|
BLAKE2b-256 | 128b72b85fa7e75318a396ba2e1b8a9de162271f58bf906e69fee637cc336e9a |
Close
Hashes for kgdata-4.0.6-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cf94ba38d3c15ba8d2e3ee161594e5e5fc0c6233b4b783cd3faef84590e206ca |
|
MD5 | 6399efdd366caaa0fd4e2b3e45a7a582 |
|
BLAKE2b-256 | e5e550c58725f11b1d4c481b1676b869b2686c38e82d2ab56cd56a8dc86d93d9 |
Close
Hashes for kgdata-4.0.6-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a5723aaa1600c93218975c60a04bc3e913c9c92462142c1d3f3c02500a4ddfa6 |
|
MD5 | 5e08f923c57c99f95903228e2423066c |
|
BLAKE2b-256 | ebc3ba57e06f8bbec19810652e456d8c21641f9da24339c8be4ef9b78bcbfff1 |
Close
Hashes for kgdata-4.0.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbc21836b8d92dc5e23c127d531d0f66c28ecc87c01f465794c29a24ac404238 |
|
MD5 | aaccab83ed3df3b686a30d95b7d1189e |
|
BLAKE2b-256 | d2c9802bc652b28bae9eb974baee962f1c7e2625c46bca7d798cbaed36245c55 |
Close
Hashes for kgdata-4.0.6-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e82d6105f4da4a9cc182a36d41229ce312af5266760606b7978f6b0ea1e2f03 |
|
MD5 | 04f5c80ba88783b64aad8584408e60e5 |
|
BLAKE2b-256 | 570e4eaa8e3a56ca6e1c26048bbbdeaa6dadcfc565e64c67a7f7d0239a1f7ea3 |
Close
Hashes for kgdata-4.0.6-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 92cdbb2a85a66e7f6f2d6788e287eb7b563546c239322a9dc036e9b1d094f1a2 |
|
MD5 | 3200c22201bb656a90936acf7f4aad7e |
|
BLAKE2b-256 | 099a98746b5754b152787f99855c234bb0a3a6e21124fe312cac44e80f348546 |
Close
Hashes for kgdata-4.0.6-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c439ed3f36ce856e1eb5b8e3206d3892f2a17250c310e7accbefa5e68f9a1602 |
|
MD5 | fb526cef349a1f8e0389b1f4d3cc1fdb |
|
BLAKE2b-256 | aca5dd6668c0de443b792b1112fa71b9b524280e90f195b2080ff8906f17c4c2 |
Close
Hashes for kgdata-4.0.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9bd9f863a91fc71423414e724baf8ea1c67756ec542658565b587e6e291904b |
|
MD5 | d2607717ccc439defb27bbea7277cae8 |
|
BLAKE2b-256 | 0e6a0b1e092f236539d4be22ea05b45d817bb2516fa5a172e47fab642b5b91b7 |
Close
Hashes for kgdata-4.0.6-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ceb7dfe006c211e8f5fadee53eefcf98ec481c705dbe54d03f089a16abb8974 |
|
MD5 | f8ff86141d73ec89e28331cfb5748e6b |
|
BLAKE2b-256 | 05aed454b111c5a9950caf5d3dc33042069a826a5a180cc146913da6385b20db |