Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.6.0.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.6.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6cf6d3e5cf73dfff246dbcf4e3332741c73d9b81285014cebad5d1ffdc4d6b3a |
|
MD5 | c972be33e166eb63598b6d229a213813 |
|
BLAKE2b-256 | bdf2170955804c176b162d6c5fdeda139fd2f5caf3e5975d7de0ef68bb159dd9 |
Close
Hashes for kgdata-5.6.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e2f396d4fb2bf407af02ca843a33363b057e4514b7af43e887f5e2d18b88b89 |
|
MD5 | 155b20c8db6f126624cc3ee171cd4f27 |
|
BLAKE2b-256 | bf972022a382edcbee2860234fdb3a74b45ebc2d89d5e49285be0a7ff0a505c6 |
Close
Hashes for kgdata-5.6.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72397765ad0f38388496c3c3394e520f4a783aaccf8dd6a323ff55eb03194d82 |
|
MD5 | 18cf5ad7e91bce6a88c0651d46e2e208 |
|
BLAKE2b-256 | 6afe319e4bdac980b87680aa37b3a18f34bacebebac4883b55ae591770b407a0 |
Close
Hashes for kgdata-5.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7aa412efae551ab969c217fb4d8f83dbfb4cc1f082dba408fb147226660176b2 |
|
MD5 | 7f4bedf0264dea8d827f522b1643b798 |
|
BLAKE2b-256 | f3397843f54ebca79df052ddeda9c57b743038559e973779b684a8c328259590 |
Close
Hashes for kgdata-5.6.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 94b6aa0397327963a614c22b597f1db2c771e463dd31de5203577163c920edc4 |
|
MD5 | 4e443b881c25af6e62e21757c9732cc3 |
|
BLAKE2b-256 | 3df36af3fe9a6d4c0e9a7dd1397807bb4e583554a07b2431fdfef80e8ffedc67 |
Close
Hashes for kgdata-5.6.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bb456b56028bafb6d062e397555d1ba4e54ead52501fe606b0af1ebda007f72e |
|
MD5 | a99f67baad0ee14841a1fa9f8f7dbca7 |
|
BLAKE2b-256 | 7e0f8c867b3f38edd2c2bf96cad3d7678eb9de0d84b4591bb04206fbee52d4bc |
Close
Hashes for kgdata-5.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f3b9c5a74259efec09c4fd89b654f8e027fbb9dda751d33d163763da9ffacc99 |
|
MD5 | 32637e1d65cab36ebbccfb13f669f3c8 |
|
BLAKE2b-256 | 2dbb8b276587fdbbd8fab53d7a2ff22966a6cbd62c3e52e5e80b8d50bb2cf189 |
Close
Hashes for kgdata-5.6.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e16642bfd77a36fcd9903a57e6bd82f977c757caa2ca5a219852c82379fd90b |
|
MD5 | 3b99820fe4af376d8ee34c744a4cd3c4 |
|
BLAKE2b-256 | d88cc057f13df992d75bc45e3492a4c9b739ea91a1a66d8c73e2d9f0dcf8df53 |
Close
Hashes for kgdata-5.6.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f1f5851ac5bc1d78280c4508c4c1f48bb757825e2d7e94190ef9928832f559d1 |
|
MD5 | 60a8bf39af51b817abd345ff84a5bf1f |
|
BLAKE2b-256 | 3e2f5e75c5a44f2e0048c54cc2bedf4d566891d3877397e7165957e1ac647de0 |
Close
Hashes for kgdata-5.6.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78aac1fa59fc8483a6dbf737a487b45325e582fa423d16fdbaade05e98198baa |
|
MD5 | 9d6f2bf12f0ea39879a6cabda2e3a00f |
|
BLAKE2b-256 | aea4744c0b62241540ce05a689b4daf398fecd005c63a6f5b450d3c166975b8d |
Close
Hashes for kgdata-5.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6310f0d205f5fb68f4a85ada17f22e35457b153572f2ffab59c97ad2f2e23792 |
|
MD5 | 7bd166cf99226aede57b177aa683eb98 |
|
BLAKE2b-256 | 76b1d4bcd9851c8c3fa1010b0bbbf67e193cb512fdb5d1d3c38aa768685ac772 |
Close
Hashes for kgdata-5.6.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b2ccb2900cbbfd898ce5c4c62f42c9000fe9bc2f35bb616811005b888152aca |
|
MD5 | 90a362d81fba58beb0fdc1536619f597 |
|
BLAKE2b-256 | 11cd2d44feaca9f4241bd7ced673e2b46c7dbb3fd6970270b44fdf9ee56813cc |
Close
Hashes for kgdata-5.6.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c41c4abae18ebdb0bb864823182f34b7f43062fb6e19ee01006328e68bb9e4c1 |
|
MD5 | 0aec79cd10efc22b316cc445f58b39e4 |
|
BLAKE2b-256 | dffc86d06c1cb9a554b4976ad365aefc2bbab579f625a273e99a614735caa698 |
Close
Hashes for kgdata-5.6.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 59870d354866f73ad9bd199fbfe2d05c9968d2dc9e3c4e16be9cdd0c820c7c32 |
|
MD5 | c64d0d7bab4773ec093552795259969d |
|
BLAKE2b-256 | c38d19741ce4bc62e2fd4195055b750cabd1fb9aef1903f97a560aed98667dc2 |
Close
Hashes for kgdata-5.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b28c41063a04ea33e9e89814246ca3a5b94783ea5cf13bed93e22d2b6ed6c1c5 |
|
MD5 | 497153efc183c3c6fedcf57241885a23 |
|
BLAKE2b-256 | bc2e2819777966a227c7b020c3a965b9a563d802867777ec2ed52e90063e0bb2 |
Close
Hashes for kgdata-5.6.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c8a05bc1f0a0856c96fc23c9d51aa8ce6cc6f15b3be0a19006e4bdfeab126c56 |
|
MD5 | e198645a2988042bf77d5d10eef37d44 |
|
BLAKE2b-256 | cb5cad85e340fb5272a698a832535581177d50dd3a0bb288d06f14a1360683bd |
Close
Hashes for kgdata-5.6.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a63ed52caee8cba4a53104f13bb57810eedfbc3f821fefc5d5b18609829fc0c5 |
|
MD5 | 1c16bcd49806854a4b06bf4d8915df4a |
|
BLAKE2b-256 | 61c8fb7eabe34c4f68a35f1c2a78f55c610b0708f8ddea5027e6aa3e2afb2870 |
Close
Hashes for kgdata-5.6.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ddb73ee73d97ed5d39ec6e57ab1b5d37c8e9cefa42083adb5225646447367de |
|
MD5 | 08664164ebfcb870600de5abcab8339a |
|
BLAKE2b-256 | b6faf316abe29a416937b1a8c7bd062bea33e33a5b0f42e1a7d31d77af6da260 |
Close
Hashes for kgdata-5.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 827b115c76f7bcdd7cf4d2453cb679a4c8035c782be60fbfd5d57684cf28cb94 |
|
MD5 | 2b2909e6b26ecb6ab0be2db98e69d0e1 |
|
BLAKE2b-256 | 0393a80df4d1d6e14c2f7acb703d910cc350f9af8032a1262a29c929f99fd19c |
Close
Hashes for kgdata-5.6.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2edef383494a337883fb167077b1f892e3d1b7ffff78066813fd1895b2a9a464 |
|
MD5 | ee0af93330c98fcd27af899406513f04 |
|
BLAKE2b-256 | 40263b78c7b4e75028d0d8db787bde6e11a7b13a0da7a6f425ae9c159f86a30c |