Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.3.0.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.3.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba4697bff56ae63955154d3ab9ad4951fc2af652b2692b16d8a783d3eb9e311a |
|
MD5 | 8731ceb4cb8b27e33545f6c00366476c |
|
BLAKE2b-256 | 470d3c19e37601aa57d769213f847c13f1fe8f9c3ef92f62a9ffd0060ae089dc |
Close
Hashes for kgdata-6.3.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3a1af477469d5f131f9acb65f76e017bf358a2ca9a27973a498579db20dd3bf6 |
|
MD5 | 4659cbe1b3915d5e7d400c7f9fb0a4c0 |
|
BLAKE2b-256 | ff16a51167ee00408ef6dc1b893e18cca2ee772711943381e8a9f2a95ed16ccf |
Close
Hashes for kgdata-6.3.0-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 607bf47003ebec27e86ea5cd4680d2fb7c8d039091382e8f2839a38f04f6f0ca |
|
MD5 | de6774b59f1f9111149d6176bd421917 |
|
BLAKE2b-256 | 3e414152be885ad69664813314314978d17214c95231bdbdea3b93e9862da493 |
Close
Hashes for kgdata-6.3.0-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 043a128a8d77aba637510f26d1789cbe07088536581794a4fb67f6df27c53ec2 |
|
MD5 | c91981e05b5db6f464e27fe22b190c14 |
|
BLAKE2b-256 | 3a9811b89b936c61302329bb7dd296aefec46f1e3b768392cd17e974eb858712 |
Close
Hashes for kgdata-6.3.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af09f298fd8863a99d5bdf3f3c88024e200c9d53ac7229686cab7fa39d098946 |
|
MD5 | 64054c6ef9d97c48363ce7666bbd8f84 |
|
BLAKE2b-256 | 7e6403974ff645b6c606a47efa48b435e53e2cab7928f2504157d34dbc543b9d |
Close
Hashes for kgdata-6.3.0-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 473e442ebdc3d64c3177192fcf044c8cd009c027069b78cbe03a5d6e7de802a7 |
|
MD5 | 43c3cc99ee6664212086d96cfb7f7da2 |
|
BLAKE2b-256 | a69f1ec1a02c53dd1c9a628ee47a74eff41bc570eb7ed13b49033d59e98e70d4 |
Close
Hashes for kgdata-6.3.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd80fc523f6276be111a76916b37e9047cd032a2f4de50a2ca24cf6ba74319b5 |
|
MD5 | a128ad2e7d1c78fbc7d0537649d89faf |
|
BLAKE2b-256 | fff3d36b73815d7beb2c3cdef82d2ba0f49302c080345594fcd1b9f979e8b158 |
Close
Hashes for kgdata-6.3.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf4e3ee1e0414b010e7bf972deb12ca194277e3735d7cc815c65486525b5bf9c |
|
MD5 | 8397518c88c30e5babb3f7a727891a88 |
|
BLAKE2b-256 | 0c8c35b6b5314509307b7aed6c05d10862208cb3539731d5ea07abbb8e16ece8 |
Close
Hashes for kgdata-6.3.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d052903bbebc9ff23a8e00ed8ca122bdf4fa619925dd8516c864a3eb7d18d77 |
|
MD5 | 56b396c2c082fa6d48c713512d4ab5f5 |
|
BLAKE2b-256 | d4d1e0d58b79cc18e60da60e29cc8a8a66e9d1754495de0a53d86e9f58214894 |
Close
Hashes for kgdata-6.3.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | db200e48e6e7ed2cbd5eb82d2919625e88722d009b9baf4348c0ced9eb29079d |
|
MD5 | cfe982fbbb95cd374dde9739520c9284 |
|
BLAKE2b-256 | d785ed26654e500b1b56885fe9f15c87b677d7758832ff9df7442737708e3d35 |
Close
Hashes for kgdata-6.3.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 70f69b1f9ba40600f19faea8a5bca4074427b5fc387a40e37f447ab19bdec548 |
|
MD5 | 716194e43b3702cc3df56bfcd113ed3a |
|
BLAKE2b-256 | 6ba0a107eb313477c0a72111fdefe6523eb280bd55a6de72c79c1f9aa38785f9 |
Close
Hashes for kgdata-6.3.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e0396f05b351abb87b1d5e07c317245128262a77367464073cfc8ae95df0fe7 |
|
MD5 | cb9d69b66ed3586b8edcfa488ad05b79 |
|
BLAKE2b-256 | a21db16c49aa6ac4227c84646d47922311f5de6fb8c85135abb66a80896c4b37 |
Close
Hashes for kgdata-6.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad1a751c753fd597696b9c0936e3c07f5fbae3de7427847152933a12db123bcb |
|
MD5 | 1fc3dbe7f82c420f35486abad636318b |
|
BLAKE2b-256 | dd42f94627eea6c06addc362cba096279b4e4c8a9dc0079f94f9d03133525fda |
Close
Hashes for kgdata-6.3.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1537c1cace7347cb6fbb1c85ab8bdfd7fe593a592dc27bb8c93bc80f4ed85de1 |
|
MD5 | 55eb8edaef12ede3e38183f5dc5b33c2 |
|
BLAKE2b-256 | 2938537b509fbb4bf9e81469d0cfb36c6b0b3756e2891d1e94b31e297a979126 |
Close
Hashes for kgdata-6.3.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26dc889a1fb82becc459bd0677b453433d3683525b7b73bc0f91af1cda4c16e1 |
|
MD5 | 53e99dd706fd567185a5e7d88da604ab |
|
BLAKE2b-256 | 316723496d66098e629a2be0b68bba3eebfa1074c2beefcef7f7a8532a9f4380 |
Close
Hashes for kgdata-6.3.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9cf804ebd875d6c9f5245a04b36839c3496f90206749a0f5b27b7957f62adcc8 |
|
MD5 | d43ba9de96e5935b523544ff3a1defc1 |
|
BLAKE2b-256 | 11707244c0308824e8ee3f4959139f96ce39bd3ccfe3f366b55b5a2de5343687 |
Close
Hashes for kgdata-6.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c55e622b4ef54f2d7e9a630ac11160adda151808a81bad4d50c46a6a5c14b2ff |
|
MD5 | 3fa19e5e33cbcc1c503aa65d8eb8424a |
|
BLAKE2b-256 | af20dfb01e7f1dabd2cfd767e199ad431abe90382274f2e030839db380f6b2cd |
Close
Hashes for kgdata-6.3.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f3aa17c730366079a0c86e4a8c2545c2041be3649a9f0e0076bd2e25160b91b4 |
|
MD5 | 7dada8707de0934a2a5a859b68305e71 |
|
BLAKE2b-256 | 6a5fdf9e9de36a1be6328b3de8e66f5156c38d1b329fbc1a68450e3156c189d4 |