Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.6.1.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.6.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 857623b968791069255421c02a03da6c7489c6c6c69bafc41e6707d5163c5351 |
|
MD5 | 1130547de6493bc0e0df947a19eb5d49 |
|
BLAKE2b-256 | 165f47040f28d866c2b48ac799b51f3cb9428a4373cc84482fed8b48412b87f6 |
Close
Hashes for kgdata-5.6.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 832d10b78fe8fa88a5ec6db451d8529d881904c3fb45676c1a43ffaad8863972 |
|
MD5 | b8cb445c09e0ca2403c6503c7e629697 |
|
BLAKE2b-256 | 9a614707575abb6729704e7186d61a99bafbcf04372f85927fe604db9ca55758 |
Close
Hashes for kgdata-5.6.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4fbefd7f8f306164b12149a24ee94e9ebde6df71ff3592c606b6ee249b33e109 |
|
MD5 | 74d5c860d68f9e9c027da0c8db910b89 |
|
BLAKE2b-256 | a3160812b59f17dbf9d64364503f1f226051adeca4ae94ce0d819e7cb6930241 |
Close
Hashes for kgdata-5.6.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b673d884fcc7ef9f15a5ceaec236c0506aa0acc2d184d46193df0677836a1a0 |
|
MD5 | d13579013b72690b54e2633fa7885891 |
|
BLAKE2b-256 | 8d6ba9c75303c622365d625f5abaf373a0b9efa8e350f301ad76bb1688c92211 |
Close
Hashes for kgdata-5.6.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0d430aafdf1f9c66df511927eccca4cd09e48ff540de179cc3a961314050c266 |
|
MD5 | 2980c85d2520f02f51a46c5afeb48acf |
|
BLAKE2b-256 | f7b6ec99f721c970c18288d61fb475a783d3d7e61f7b02b59850bf0f4f85d6d4 |
Close
Hashes for kgdata-5.6.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | df815e4bb8ae4d41370be44bce113df74103ef36d7132e1ca8d6d07700dd4e52 |
|
MD5 | a008d52f2d9387f815f4e838d180f78d |
|
BLAKE2b-256 | 7d9b9a2800f8ce41d0f56d420dcff6d11a4f1342dd0741e6236edcd5ab03da45 |
Close
Hashes for kgdata-5.6.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b2b5877319691c6555cea5484b6770d971a063389195587aa58a550777b11627 |
|
MD5 | 2c2f8f70e02f0d78e6892d9f1ec2bd53 |
|
BLAKE2b-256 | 70366ed692b11d586c487049034eedc12259240a7a3cf513547b889d269adaff |
Close
Hashes for kgdata-5.6.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f0589796a2f5a5ecfea90fe503ce9de91f9b8d1df90f4968a18d9d609ff0dd0 |
|
MD5 | 39700266aeae5d99eb3fbe732a83e91a |
|
BLAKE2b-256 | 71b47464674b0101648fe68a254b0f6ef3f5b7554eadb0fb9439ac16b830803d |
Close
Hashes for kgdata-5.6.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a002eb543ad723f87e9d1b10b501d0556942fd09a17080b704e0c7727dcb551 |
|
MD5 | 65e0fe2cca364d4ae5a2cc707da0e335 |
|
BLAKE2b-256 | ae9572683b4487a953a7a1c924b2c888e5ba8df7605c1ea3496677c09086fd92 |
Close
Hashes for kgdata-5.6.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 483363ab1c20849a6de293e280c71651bb37bf4564c97d8c8858c3d8f976421d |
|
MD5 | de81857ca2a914ac22f0c6679f6e82a2 |
|
BLAKE2b-256 | 4c8181a05a8836f0923b2d3538f35827eda8788a033180872105336c789e2618 |
Close
Hashes for kgdata-5.6.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3dfe38aaf79ad640d1fcf4f8e2331ad34a84717efc5aba7a011666ad27a2d2cc |
|
MD5 | a0bb9d3041be38ecc9db4e99d786c69b |
|
BLAKE2b-256 | 3e6c91a2ed74d240982eed913d6a6c129694d6cef2ec6826a382f432f6fbe80b |
Close
Hashes for kgdata-5.6.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e921ab3763ec3df5aa1a20155b393c931b40b26987f5e3f373e0f34dacbe00cc |
|
MD5 | 6d1572aba08d683546f4dd813659ef24 |
|
BLAKE2b-256 | 7dc05130b70a11d51faee7581705a848f829da0432f30fe083c53a03a264a8c9 |
Close
Hashes for kgdata-5.6.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b999c1f2d2f325e903f392d7f8d702704c239c8123047eb49c9a61ad7e1bf88 |
|
MD5 | 62a1c2b2913f204970926f598619e4db |
|
BLAKE2b-256 | ed943de6d652b2c3400f1a5c4860771350b204fe43a40670e1dd60eaff620b93 |
Close
Hashes for kgdata-5.6.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7dbbf90bbbe3e9ef6baca58f49c72750b7676153545d213a8def07a35cdb3051 |
|
MD5 | 200c38cf766ce3b1dc1f881eb296c1ea |
|
BLAKE2b-256 | e0f2105e0c9a444865c4efd8e3e5209657ea356ad1b35c9827814a5b417f4fc1 |
Close
Hashes for kgdata-5.6.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2020d17f317009943fe10419e850b8f26c0c9f887b790a9bf5fef5209829935 |
|
MD5 | d255df55c8814b4be897b300df850b6c |
|
BLAKE2b-256 | 25ed1b27c1d40c6f958d84a31f109550700f771d36cafe6f4b0c9634f76db873 |
Close
Hashes for kgdata-5.6.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0aed4be6bb9ca1bf1cc917377b799d2aab860ff2782b73d220382603d4e0b8c2 |
|
MD5 | 4dd3d2c4a352acf270bb64fce94c82db |
|
BLAKE2b-256 | 80ecd6838169ec22bcec2717ce61e9a6579fbe7bc1511d8841ce4f0dd28b0b7d |
Close
Hashes for kgdata-5.6.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 060afdb5f892a2eaef68770c87aa5560c0509cd78d63143a6aa33041ad4e804d |
|
MD5 | aeda9e5bb3a28087affe08a6761e3d12 |
|
BLAKE2b-256 | b0e50bdad666c9e309f71ebddf0e3d6ce07a80ae30595c6223671831e3bde2a9 |
Close
Hashes for kgdata-5.6.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5997517cc28ee3e8c5a30cdc4a8ba970490fddd5b35fde0414575a144f20dd0d |
|
MD5 | 52a370a0446b667a5071e3bde541854a |
|
BLAKE2b-256 | 866a91d224695a0a78864f9227581fe596800f7faaa4844f3038cb77d7e95ca4 |
Close
Hashes for kgdata-5.6.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8629357ceb735648422202a639651986f2f794bd4573130aaa8d28def4e6b075 |
|
MD5 | 1dc0abe19f05703e393bad6dccfe31ca |
|
BLAKE2b-256 | 23e48a6fcff773deeebe470fe0256931a32de063b78c0a580c7dcb3007a51e20 |
Close
Hashes for kgdata-5.6.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21f083ed5373b6631319209a07bf220dcf498fb7708ae8c179076e976685a0ac |
|
MD5 | cea285083d551aa247ab9c6c0aa2c3d4 |
|
BLAKE2b-256 | 9bf026077ec2cae6f38cd84d28d0a4905d20a7a765deb0f742d3f85e80e2571f |