Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.1.0.tar.gz
(122.7 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.1.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f0853271b1233dc42d52197b1ce63b9d88950313526fff2cd41bcfd847b5abce |
|
MD5 | 6e4e0c675cf6444ab10fa15d9b1326ee |
|
BLAKE2b-256 | 7f4bbe5b0aabe13ab11efd259c47d1862cc6df471163d3b57bb3f00f8a058e59 |
Close
Hashes for kgdata-5.1.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 03e9ce3263bc275a17a27d4957d77e8a5ea9c31a04f8ed7a883b05a8a0a5f6ee |
|
MD5 | d316046a58f4b035af812d1296b564c4 |
|
BLAKE2b-256 | 1ed699ebcb281a0d75f2d96f6d78f5c520d2efc61055ef27801cfbb5751a0d1b |
Close
Hashes for kgdata-5.1.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bfca1707360212258fd83e9fe0794c617375fcd45d6fa2fed6c73490657887af |
|
MD5 | e054d390721f9ead5a9cf9bebea36048 |
|
BLAKE2b-256 | 8eedd0e887a4b1083c9646b8283456ed608fbbe0560d70f397869af87bf6048f |
Close
Hashes for kgdata-5.1.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 967f15da0e3f2d55b44cdd67b13b662b6613731d6405eba9317cb6b37fe74e70 |
|
MD5 | f1cd95c3a37e14f64dacc831257cd7b2 |
|
BLAKE2b-256 | af92d8b662b340c352e06e37b817b3a394eef6c54a2b9059f1f8798175332152 |
Close
Hashes for kgdata-5.1.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e1d5f776d4997ef0da332c64a6098ce5d1e8b129634b9b0256e4fd5f5134ce92 |
|
MD5 | f9b0790f43055baa03b2b0d118b70e8f |
|
BLAKE2b-256 | ac506d7a091979f792f10321fb91b2bbe9aae877a360317d9aca0079dcf534b9 |
Close
Hashes for kgdata-5.1.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9650b4ce7c3c2d32a509fb01521f04025c207b641b9a0caa418840362d5ede76 |
|
MD5 | 04d66570ab1b6b7d33f908e8aeb958d6 |
|
BLAKE2b-256 | a86347a99dbe3a3cd75d28cbe5f90b7ec97a5e4ed65e0d1ac9b8e8d92355a4e0 |
Close
Hashes for kgdata-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 350e008a867507ac9174bad2772c5c4fe6fdcb92af3755688b84b47ee9d0157f |
|
MD5 | 847d89ffa64657ad1810603ba56171f7 |
|
BLAKE2b-256 | 9518b1cb2eca6edd8cb19d9cf54f8efb34a91437108c5dda7ec34e70f6067611 |
Close
Hashes for kgdata-5.1.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1af07c4ca3ba14bc6b707d6efefd42a31e1dd96c8b3072a35b6b9dd7bc25a6a3 |
|
MD5 | e9c6f784292bee0a29f8683c75b86443 |
|
BLAKE2b-256 | d2b38e9d799abbc6bab2c196d5ed2e16ceefcde27c7ca65ea9f3c12e32019ac3 |
Close
Hashes for kgdata-5.1.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ae65398f1439cf455ef65cd45266aadc5a92d58b23d0681ead0aeb942b643bb9 |
|
MD5 | 5febdffd0602e7bf1e8e2ba792e952e5 |
|
BLAKE2b-256 | 763de6fc408f9d2bbe537646339a48a7e654ee1a8b1521e13edc30b037d978ac |
Close
Hashes for kgdata-5.1.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d0a259b4f9cba33c0ddd23773ff05217fc524a44cb5c91de57bbb87f77e02d35 |
|
MD5 | 13e6329b023f1a8a41fc0dacc67f8d3c |
|
BLAKE2b-256 | 02ee5c56c8ce55c747ed59f659a90dc8c49ad16d25199ba7107c5283b112e47e |
Close
Hashes for kgdata-5.1.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f1cb9fb3cba5ac80dc00dec8ef88106cf9f4638b1ff1a6e6deba5078e401d663 |
|
MD5 | c47a779dbd19123aa16010b19b541aa0 |
|
BLAKE2b-256 | dbd71a15eee39096e408b1f98ae6becd1e3182cbd675938de37a55f8e07e33d2 |
Close
Hashes for kgdata-5.1.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c286d3ff19bbb671af7ec3f6ddb97db3dc42517c6420b25a5e11a799776c040 |
|
MD5 | c55c38b535fc4f0d66d76f5bdd316633 |
|
BLAKE2b-256 | 737f01b1681221fe1e62b9deb51e8d9cb75a4322a99d8b10a6ba1c22f06b74c6 |
Close
Hashes for kgdata-5.1.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1760450cdf0a26463f5906cc286fdca6cc44af99bf7ceb258a69db100c67b364 |
|
MD5 | 71d046244297586c10328f3ac3147574 |
|
BLAKE2b-256 | e819aab3c5b33a5fdf98c28e6a3f80dce0cfe861fda5b2bc4f33548e93b5f9b2 |
Close
Hashes for kgdata-5.1.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f0ed32a55d330ef05e21151fb967fb5e87de312940af153cfb088c213e4a51ff |
|
MD5 | a46f91a1def047c8ccd75cc3fa34ca8f |
|
BLAKE2b-256 | c1d85d3477f62820e6167561853e664bbc0a5a245a8bbccaf5a220d7694b8ce2 |
Close
Hashes for kgdata-5.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a2557578f4ed4bcd4646f1481368871b4c2c43af0350641e4b2752ba1660403 |
|
MD5 | 0960ac7ad90a2ba702e954c918d0ab73 |
|
BLAKE2b-256 | 4364625bc3f5fff676a854b5f4c6d036053ccc72222258aac01fa21315e1958f |
Close
Hashes for kgdata-5.1.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12d994820bf5c912e10ec56af685e6a73f147aa57d1808084af9d3def5aa4a7b |
|
MD5 | 98625463cbd5e307e0518d00904be406 |
|
BLAKE2b-256 | 0053d4dbcf6b2f6b1b16471a2dffbf82329a0778bf98b761a7751ed776ef327f |
Close
Hashes for kgdata-5.1.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d16ff904f973119aa1aefc1227add56e891d8c22547c3022cfa01cd5d893553b |
|
MD5 | bb75a3912a1bd4d3581efe764b41bfea |
|
BLAKE2b-256 | 0d6967b6d240a02a5c90a6c2fcadc7bf86f52b3e8737703dbb71765b225676e7 |
Close
Hashes for kgdata-5.1.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a207179c97ab394ea7d9e0a58ec2b8d5b70d389f6ce17b0a6e5e60912d1ca37 |
|
MD5 | 82304ae0104824bbe13e3f0f308c2cfb |
|
BLAKE2b-256 | 4e78e97098f485bee9c1a99ddeca595cb71245ee9f0765390653cf3a34508054 |
Close
Hashes for kgdata-5.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 885d07ec7a138e749be49dc4e8a4f2f41b3fb293ddfd7e55ec1bc6f253b7fb17 |
|
MD5 | 26e412aa78e8300605450641405ad6e1 |
|
BLAKE2b-256 | c6c0d8848438628a78f91c2acc75b92f8e4a008382e45ae99f126bdaa09a37a6 |
Close
Hashes for kgdata-5.1.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 12525250611dd410ac6280c9d00f3cb4a504079e92cf5f99ca8d908129f092ef |
|
MD5 | 4c5230af590f09927ac065b88417e4c1 |
|
BLAKE2b-256 | 12f3524f1ca9a7c7eda070211016b2d4ed5a0e0574431eb58eab5446861f5b6c |