Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.5.1.tar.gz
(144.3 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.5.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ccdc4d07d96367c2a6bf0a419911bb2f1ec5eacf3150ef9390ba900f5a5079ed |
|
MD5 | c7b55c628227082f988597fcd33911a9 |
|
BLAKE2b-256 | 7904521401bf977be95fc9facfe23641d5cd598a2f2a2baaf856cabfb90db916 |
Close
Hashes for kgdata-6.5.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbdcc8ee572b74b0fa08e6ed542b4c393a0c5ec8036e94c861ae50b097f71d20 |
|
MD5 | b5d93d1d9ead243ad23eb5ab2f7febe2 |
|
BLAKE2b-256 | 0e6f4d601d4d0075340c71adad8e70983350c6d0ac2ede1b8e6e176d5967ba49 |
Close
Hashes for kgdata-6.5.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d3e43fbbaf81351cf20fbc243e3feb752bbfadb49bdfbf2e5cb6a085168e1dcb |
|
MD5 | 9669a54b045434e3f500916119961694 |
|
BLAKE2b-256 | ff67e33026e3c0c4c2bdbd1640635585ae87b5c14d8d2693d34169784f1162d4 |
Close
Hashes for kgdata-6.5.1-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bda1c567c45a6fcf9f9568bddd58ce2a08203b4aa90d2d800c776c5effb82955 |
|
MD5 | a958c758bb8340469058ca61a3b9f275 |
|
BLAKE2b-256 | 41363484256165dc694cd4610d58d2f8bc9c99a42891225bb9e9d6822aaf9480 |
Close
Hashes for kgdata-6.5.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 57f284f4aadb8f6fc974a39b7614e28e9110188f279e56dd9d3be23693e40cea |
|
MD5 | f3897c1d74558781d4f4d41e34f8bb92 |
|
BLAKE2b-256 | 1a6648040f327b96fe7a29d67bffdf624df91d827e835da1f16c50c960559645 |
Close
Hashes for kgdata-6.5.1-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c511e52cf9b24b29932291b7512b25468c3d24cbc4bbfe8c24ca107600f17813 |
|
MD5 | f7aa063c3922ec320cffda171c57ec81 |
|
BLAKE2b-256 | 61f613fb45880b3e0772797deb15e8e9298522dfdfcb8fd08974238631d32d87 |
Close
Hashes for kgdata-6.5.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9cdbf5e7a39067e013f6c11557d2a0a22b2832ce1e3f34c50372d9459003a37e |
|
MD5 | 1a8168a461be8c51d7d6e77bdb93f1db |
|
BLAKE2b-256 | 00a142a90672de0351093d6763314ace70e92ae1aa5386596ee35b62ffa9843b |
Close
Hashes for kgdata-6.5.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8274f62d063534f2a625208622781e4be5fafe4fa6d611bb5a9d944df691c44 |
|
MD5 | b71fe944045fe4ae7cafcfd20dcff949 |
|
BLAKE2b-256 | 739695e44e8d356225e195ba5d740ea8faf6f777f5ccb5eb6ee0202c3b3bc390 |
Close
Hashes for kgdata-6.5.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f11878d1011b1bc1b69e6c1cd36dd1fbd89c24e8db6d4e43a530bd3094a3e4fc |
|
MD5 | 8ac01f4c69e3f3f20942b185192532fb |
|
BLAKE2b-256 | ed1023fa1e220df9ea141bcda8a702e541598852a842d207e82b699703ccd8ad |
Close
Hashes for kgdata-6.5.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 69e0ea7abc849e45ffa61e8c8af36d4852089ae497c42b1b015a86b314b6162b |
|
MD5 | d1f5f1a1ba33fee7ccb7c6b2b62d7a2b |
|
BLAKE2b-256 | 980d9c228ecb69639af02559ee036bcafe2380f04c4debf0ff84be6d55c3eadf |
Close
Hashes for kgdata-6.5.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 952db6f7fb905a530f35ce9e98ad0bdbaa8f6a3e9c2fb6e4b7a2215bc0ea5a5b |
|
MD5 | 38c85cefa1d299ca16cb9f12305206c1 |
|
BLAKE2b-256 | e84ba3f5f1234c08232cdb4473134dd14551c1eeb0fdf10e6c4f54cd65614e4b |
Close
Hashes for kgdata-6.5.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | afe4e8fa96ed1a8f4998c6ee1e9edb90777c6150138f70891d20b7c3705c9d9b |
|
MD5 | 18527cebe05672d59e78ca85704dc19d |
|
BLAKE2b-256 | 9ad720fd28f51fc19f00ee14f02c8b012bae3357c5f9b36dac73e144192618d3 |
Close
Hashes for kgdata-6.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dc6a7cf5400cd90ea621b24ecb3690898de61239377e6b20b6bc81b9f6546e66 |
|
MD5 | 2322846f7c1f8f83c3f263d34fc1d276 |
|
BLAKE2b-256 | f21a2cbed839e52e14f357cc1500e712712d8de0a2b71faff412b96e1d8ebd2e |
Close
Hashes for kgdata-6.5.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 76052516e3d7849d8270248a2e609fc0a8d0ba87f25e1c2dca39f4f6dfbc92d1 |
|
MD5 | 5930968ce1f75ece7152659798faccba |
|
BLAKE2b-256 | 887ced13654e7ae6aa490f8f211423a53806ceb7eabbc2b422a66fbbd1f5abb4 |
Close
Hashes for kgdata-6.5.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3dc868d75f65c2c7895d3a63897ddf5e77729d823e0de64e621948e9a950b942 |
|
MD5 | d781427ffd02c192fd2e0cfbb914cc68 |
|
BLAKE2b-256 | 16a973c15f329e79fc6dcbef4302a105f4d9c521ce2a98a5ced7124e0986dd19 |
Close
Hashes for kgdata-6.5.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4f767a2a4fc2fa906cbde6f846f1d7d3840959fa0829bf422738d274c9757ec2 |
|
MD5 | 628349fc4486bbf2a898e96a7fb8812f |
|
BLAKE2b-256 | 716bd6bb771039c0c80866575861319fde1eb733bf1328d97cdb35e209cb7496 |
Close
Hashes for kgdata-6.5.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6b7449be0261d24950b7e5c967be34a03d38f79f5174b68dda1d700b55780834 |
|
MD5 | e9b8e6345c42843605c6c7a9a9557b0b |
|
BLAKE2b-256 | a4cebfbffba258a62d60e9d1072a9bd84a601ada79388f909ec7ae63b04fee0d |
Close
Hashes for kgdata-6.5.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cbf6d82095ce6e707bccdada63ea86b2bcd3dbd9f73da6ba507c261e3d302074 |
|
MD5 | e2e55fd4295dd29279cb2fc82eb2e34f |
|
BLAKE2b-256 | 0433cf4558e032542dd93bf4dd880bb93018567c5b0022b574582eb354be5b15 |