Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.0.1.tar.gz
(109.2 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.0.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0cf70252895e5084999e72b6e623766037f921194c2a9091ccb2d0fc115e427e |
|
MD5 | c156fdf19f37fee6b0db4166a7888384 |
|
BLAKE2b-256 | 64ad9ace97ccd0ab357407beb271b85d39eb3bfb4ff16c71b3cb180f5007e24b |
Close
Hashes for kgdata-4.0.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 39d77187965b0831fb7d1bb3c3fda499975e84f1a3fba526ac207f9f0ec98747 |
|
MD5 | 2e156275f81c6d1c2e0469e1a562f9cf |
|
BLAKE2b-256 | 66c70ef435bcf1a9dcf252a55a62c35066666b5e86bad23e43f88965013c0f98 |
Close
Hashes for kgdata-4.0.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c27cb48d60c400c3d9df63191b803da3c18408e576a00d844e5179b31a5090b8 |
|
MD5 | bf8807d62f0066c3cbd0592a4984f20a |
|
BLAKE2b-256 | 1eefe53a2b1dbe504bb84c1408e3769da0d39d04de5e7e3a04c5d8457fe4ce14 |
Close
Hashes for kgdata-4.0.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8d406e55639ca67e7db6e7131be4ef4ec08d5f325aa7a6793764d0876a1da114 |
|
MD5 | 8ab32be31aad6c3199245272809b49e7 |
|
BLAKE2b-256 | 323d1d182033e8c29917939b38a297a2b8908fbe4f2e22386fd5e45f762bffd6 |
Close
Hashes for kgdata-4.0.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a2007082190ed0c635c9ac58d706f3105207d9dfa4ce8e07d6a470c58ae3e10b |
|
MD5 | 9329fe743796f3a8444555b1d4b00cb2 |
|
BLAKE2b-256 | 95385eb21e7cf3fa29bdc1e4245b80491928fc6aaabd485962f7754df69bf1cf |
Close
Hashes for kgdata-4.0.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42bc7314edc3c118437723a673fb2354957560f874fc4614d698c12dd4a44966 |
|
MD5 | 223a69f235c999357e5186dc3d9ffaf7 |
|
BLAKE2b-256 | 7f811fd397ae488b5e04198f9267bda477ed5d00c28ee84e9b80f6363d66373b |
Close
Hashes for kgdata-4.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f04d7e80643546a03cc0c59555f4da1db0a2d2ba3821613d6dc075f329c87f07 |
|
MD5 | bbebdf026e4649ae3f97f5fae9304aea |
|
BLAKE2b-256 | 5de84727d6de63951031e14484831e25539ea764801a0ffd573664dc5ca31604 |
Close
Hashes for kgdata-4.0.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7d37e508663e87bafac677e17104e7ca75064b104001d86e47664f1bf96a277d |
|
MD5 | 6a68028cdb95d2c828085ede2b23c089 |
|
BLAKE2b-256 | 8d9b36e895b51993ddc653b6f4e2a646463b89cabb4816468d95c72dca5865c3 |
Close
Hashes for kgdata-4.0.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9c81f5eb3602ab654998ef5b164a781ddfdf32f26dcbe2db6036578de31ea99 |
|
MD5 | efe35158b29df0c127b82b265e351208 |
|
BLAKE2b-256 | e19f783b1ba6ba128cd54e520b4333041f814fa253429a1b62d21ed5ab320b89 |
Close
Hashes for kgdata-4.0.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77d1b9683512bb110bb470dbc2933b5652a276dd93cbba8a7dbf02ad959f8049 |
|
MD5 | 93a2e7a03c590bfa72789e1de3752d94 |
|
BLAKE2b-256 | 99dc10b2e405e1637a0261c67ae3b0e62f9ba6142e7c69e3f736a901615cb206 |
Close
Hashes for kgdata-4.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7fa02dba658f2b62ce0e76a45f33a9830eae177343e4d8e5a07f19faa669ac5 |
|
MD5 | 22599677818394d17eb53e98a999a1c2 |
|
BLAKE2b-256 | 02dbc4ea60043ec03cb0e1ead434d45fa0bd1e3eb0f663434a42bf698f5e5da5 |
Close
Hashes for kgdata-4.0.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e32f16c8eebbabb05ef6796fe1b6bd2237b47f2856dd4c92ff4f251824204b0 |
|
MD5 | e8f71c1b12ce56d4d5080088d8c0a42c |
|
BLAKE2b-256 | 425bfa4fd590ae0597df21e9e0d9a244a940308083591741ed221732c535f60d |
Close
Hashes for kgdata-4.0.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83124e0c7b65dfc0e628fd431add85c7d54e0043913626ca2c083dd29f039c30 |
|
MD5 | 0ce8e841ed6d9d5232502a5f0c44a665 |
|
BLAKE2b-256 | 1748ce6b23f4959eac11ba8af0b47a50ce37f9d3be5b780223023275b3411791 |
Close
Hashes for kgdata-4.0.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e6ed640b3da229c8f7ca37987d48c60cfcffd930d9aa2f11a1e678a3f4bc9cd4 |
|
MD5 | c879ac3fff1200a978ca042cded8e7a3 |
|
BLAKE2b-256 | 3cb08511ee793c1b6a4140585f3879ae239e88005ce08eefd6576749304673ab |
Close
Hashes for kgdata-4.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2753ffab2861ea8e3058d1f387105bd70c725a3c2c6479099f92b5a4b57c5dd9 |
|
MD5 | c4b468a319b983f57aa326e129249ee6 |
|
BLAKE2b-256 | b639b5b2e45894e6dd7f50daef7823ebbaf6894b1e1fd3e9f0fca7d26c143adf |
Close
Hashes for kgdata-4.0.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5ccbd34f89bf362b01ec1863ea1d013c0d35e9664d6917d806bb563370d71248 |
|
MD5 | 5d2906cf26043f94505df4d48cc5d744 |
|
BLAKE2b-256 | 083359ed772ff7b28cdee41a7f5b5427e27395b3b57fc2b68360d964340e13c9 |
Close
Hashes for kgdata-4.0.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 982db1a632467f60a12bf1b47eb22ebb7a4047910875f5fca2d830abee054e24 |
|
MD5 | 3c863d9f188975b976e0ee2823e315b5 |
|
BLAKE2b-256 | 5602c17d7d20f252e31b0747326511fa340c0fd5662270286451bbc99d44bd38 |
Close
Hashes for kgdata-4.0.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e212363996bd49967885dd1c58618c88b3ec40db94e878dbbfa5cad407eead0 |
|
MD5 | c369e4d91306a45515ab0c511ad7a322 |
|
BLAKE2b-256 | 2e6aa1ffbdb38146117242a0a3292c2d60f7c5f0043ee2e21054aee22b5bc1af |
Close
Hashes for kgdata-4.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 44c330d68caa83e1a94df2f92e61ac9ee42d3454876d28c4ea138af8c4955cfd |
|
MD5 | c5d47a0c1d0456a7c8d246e33c872c60 |
|
BLAKE2b-256 | 8585ab1fbfea8c8acf1b27c9e76fbe424f263036752599ed949abae5d46215af |
Close
Hashes for kgdata-4.0.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d635999cbaa7a26c02cfaa9cb5c843764377dc3e40df767fe56025b5dbebd87 |
|
MD5 | 63b4e29f61f896add28c14938879cb87 |
|
BLAKE2b-256 | c58edec19a6441331344a5500a57179893e67b3cbaa33d447532582045daf226 |