Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.0.0.tar.gz
(123.3 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.0.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5486e2504b5ee9e094398e4c2b3c5c681c014943fdd4a12585334e65af4fb1cc |
|
MD5 | 7a7b9d313dc29fc0b3af57f239abeb46 |
|
BLAKE2b-256 | 0127395176091223bc1f1855dfe3ecc7a84580508b087c6d4d2378ba03d07388 |
Close
Hashes for kgdata-5.0.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc57b83bf1e700bd5d73689bdb778ec2000fa72413e957fe830cea64d648a41d |
|
MD5 | c207dbae112087d567dafe639b292c11 |
|
BLAKE2b-256 | af099141c8b4fcd3ab25f2d1325005c2ee9292970813e303cd3ad00a02425531 |
Close
Hashes for kgdata-5.0.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e7cd58a6291c6c9e025d6359dd260d184d5eb2629e5c10d0b18934c1f214ab3 |
|
MD5 | 307b2583c9ba85e7c91ebc306bcf4b4f |
|
BLAKE2b-256 | 34592bb33f2c75e9b9d64a367c864eaae9838e789b645c9d3d339f3238249033 |
Close
Hashes for kgdata-5.0.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9617cc8f415c2b33ee825430095d93229efd11afd7180559224c686410eed978 |
|
MD5 | e6448067b14e0aad8bf35de85199cc3c |
|
BLAKE2b-256 | 0bf2744b460725ee510774ba2453496a2f6fb1d4c5197ace457dc9fda37a41cb |
Close
Hashes for kgdata-5.0.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21583ff915f1ab41f3f9c6c21674674517c5b6b79bacb7117f03ae9abc1c3eaa |
|
MD5 | 89b02e7e5c0f2bfa98893b2f900e9772 |
|
BLAKE2b-256 | e3ac5fc1f7f61e198d34f0d1e0bedbed4408c3eb47616090fc14b092ffb6f619 |
Close
Hashes for kgdata-5.0.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 284a612d7f5dfaab476ffbc46a0ed667098587b0d5ffb7258cae818397c32b10 |
|
MD5 | 1a82e57e49af69ed7922d9f03ccdc2fc |
|
BLAKE2b-256 | 8b84d09d628b45012f587b52d6e8f9d5da941a7cbea2551b3ede4f6c6f61aa70 |
Close
Hashes for kgdata-5.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77249d7383d8207560c530f7b5b252422945e9a2f312352275ce9c64734ef9d7 |
|
MD5 | 0ce7f0770163a396583de3dc568d08bf |
|
BLAKE2b-256 | 4c42894af7d0d7f654e644d44af32c13fe467783c07cadb6d9500f2298c73ca0 |
Close
Hashes for kgdata-5.0.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ff6335871751596f1bfacc1e348c290d2dc5e3adb37fcc43bb721336704d39e1 |
|
MD5 | a77ff9191d9f95ce583f965ff8bc4926 |
|
BLAKE2b-256 | 6d9cf67616d8856df201ffb5f95b143262123022e41b05e4a2f6e8bfbc3e7c8a |
Close
Hashes for kgdata-5.0.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 447b66df277d5a08f3d6c76d5a2b8d6bcf81db314f70480b8fa6a7a8e4dced6f |
|
MD5 | c2cc81844108974060f10fe3bb9bdbc5 |
|
BLAKE2b-256 | 28ba442c4f23d2128a7f3bee10fa866b5a19a99a6a35b7557f89437b596ac669 |
Close
Hashes for kgdata-5.0.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9cb6d8ceff6ab736c9657c6b8941ca7819cc48f958b7eab7f8836489e163f18c |
|
MD5 | 888a6358c52d9850227e00a9e2bcd538 |
|
BLAKE2b-256 | 640cf782933269db6030f98f14bad3b04060a39f7388aef82de2330bdaee75f8 |
Close
Hashes for kgdata-5.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8abd7de0914d0716bd9ca3bcce4d2e3e7b8956241045c230a7b84bdb7b71cd31 |
|
MD5 | b060223127a88529ee4941ee69331749 |
|
BLAKE2b-256 | 2be6357c5e742116fc2c5d507e5025129f734d3fc9313656e9f9607151bcf675 |
Close
Hashes for kgdata-5.0.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 843601b0f4906f0b0799cc9b09371bb43c4745b6dc3159053700008613f4130d |
|
MD5 | 6a78aebb66cf60835df0e290d5a5aca9 |
|
BLAKE2b-256 | 88b616a7798b706a16be4c453ce7cb664c9e80086ed557bfb6b807d1bb0404e1 |
Close
Hashes for kgdata-5.0.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 585bc91a317bed9f8291c2ee81aa3b4130d888e677ad555a75c074936e2cd9fb |
|
MD5 | 43c235080857031db77334f658c9f105 |
|
BLAKE2b-256 | 49db26e502917e83cba43dd2e63ea994ba77e075ad2d4380ea186905bc6487ec |
Close
Hashes for kgdata-5.0.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b784150f182a39698122f302637c08682e1f229bc0b024c4eec6b1799dfc957 |
|
MD5 | c777020d673309683b35c757e6624232 |
|
BLAKE2b-256 | 92c9ac93787f3e0aab406933df9d60dea123b09f5c1f9600f1153f9ce2ab43b6 |
Close
Hashes for kgdata-5.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 81d67e0292495aef9b3013a58905fd99c6d74ae1c2fdba28fa33bcbc4ba5c60f |
|
MD5 | bdf870dd73d9b8522f16e85a83ae18c2 |
|
BLAKE2b-256 | ad7da1f81f788584405747ea5219626f7af7dce2e62549dcc8a118d216c33444 |
Close
Hashes for kgdata-5.0.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1eb890b1f07d48f4da2a45fdb05f2684b0414a4afd5424a2755c38be69c3c44a |
|
MD5 | 06e848c0bf5adaa03896d7bb4ecd183c |
|
BLAKE2b-256 | dad709cdebb1698bc4587615f110c4704e118e8e8dc7718ccee3cdf4618b9d40 |
Close
Hashes for kgdata-5.0.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 21431f8e70ed3b28ae47829a4fc09d3bd70f24cc5bcb40c3fd75ea6bfe4a4fa3 |
|
MD5 | 55e170f2362c5ec1bc0335c3b46612df |
|
BLAKE2b-256 | 7a41d4f069ca37656d01621f93cb5126c4d603a5173deb44e3632b7df5d3cd6b |
Close
Hashes for kgdata-5.0.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33af745e86c7a224af23c30b6cf4fac7fbfc4ef97288b4605310c1b0584c24d3 |
|
MD5 | 6d0fe4ebeec79b18792504ea1235a532 |
|
BLAKE2b-256 | b8164603db66362cae37c21ab38f6fb2a48c11d6c64189abbccd9501591813a4 |
Close
Hashes for kgdata-5.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a3291aade4f4b2acce9440af8d8fb8988e4031843de61aad304332a611d92143 |
|
MD5 | 2aa7f1b4a782b55b51d0e03572e8f9a9 |
|
BLAKE2b-256 | 9f761ae5c3c0542368790d05cd82a071f46024c115ae68fa23ab605ff87b51a4 |
Close
Hashes for kgdata-5.0.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f25de355e89eefbbfd1e5108fdc05d9f98e3a9d5a73f0706671b9c6f9b7b074e |
|
MD5 | 86f1bc5ff449329b6675aebfedc44a56 |
|
BLAKE2b-256 | 2a0c08979c0e73e1e5901b8da9c77599a4aa67e58521d780128012b279858da4 |