Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-6.4.1.tar.gz
(143.8 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-6.4.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7cad3a612ae7c930e4efdbc101fcf249a162a1430e431ae2178af7db80ca72f7 |
|
MD5 | 59db6703a99dba708044dcd2e99bd08c |
|
BLAKE2b-256 | b07b58b3f88228cf851165d5722ca8101e434b02f0f4ecce4545f328f3aad535 |
Close
Hashes for kgdata-6.4.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77c1671c783dafa9ae55950a26a544d156dd0f0f6f0baa7b55b5d55a3fe0d6a2 |
|
MD5 | ebad81805d646ec9373ad26df69aa5d3 |
|
BLAKE2b-256 | b0334db23f9507033c0fba468c8c20cca73967db80365b1c6ebb8fb1f29f87ef |
Close
Hashes for kgdata-6.4.1-cp312-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b77795b8aeaf895fb9bbfafeeafd745daaf2c31cba7cb6fb292536630965e737 |
|
MD5 | 99c727f1baf5ec137184ebda8b3b666a |
|
BLAKE2b-256 | 006377cd0925e2e09a521f2c85d9d8a7411e71fbf885eb17550aac81a615bf9a |
Close
Hashes for kgdata-6.4.1-cp312-cp312-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e5356d13f8167f10af8340e7bca7ed37d5981db093823130de31b01772e6b7d |
|
MD5 | d24e9ea94a18086417d7e545024a5278 |
|
BLAKE2b-256 | 9769435afdf3b006202b7834f259cf85703b6ea59ae03bfcd6d01d02dfd01dfa |
Close
Hashes for kgdata-6.4.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c2678c84e25744a3db5ceb4fddf14173db2b410335e0d80786fe25536405d3af |
|
MD5 | ddc1e5e0bd859929bad7242c2f2e345d |
|
BLAKE2b-256 | cd00005e01f42a371ad92162f88084f93db2f25505e717717a77cc5b9c92707a |
Close
Hashes for kgdata-6.4.1-cp312-cp312-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 092ad2fad5b489e033c4726f6e7b897b781f6475792cb33798e8abde3e734132 |
|
MD5 | 5642e97f737bcc3b3d1fb271cf7e5ab2 |
|
BLAKE2b-256 | 7a1cda0f937616998f99ec6d7f12e7f4e345dac93a54f91f8ac02dea7a8090a7 |
Close
Hashes for kgdata-6.4.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1c53357777588f5bc9828b824d89f8e64d5a556355a6ec91c81673c84e5781a5 |
|
MD5 | 11b6cf0f708a44b0599a6b1c0da2326b |
|
BLAKE2b-256 | aae6eb82a0365f9d21c2e517ff6f9bf41fb2a3c0348642f8a060d73228509c15 |
Close
Hashes for kgdata-6.4.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3d8d34f0fd0bb4a980a67ca338f2602c89d675eb1b3119114d34dd9fd97d23f0 |
|
MD5 | 661f7853dcec8a6edf4e9a9965ff5e35 |
|
BLAKE2b-256 | 2051aeb7481952877cc47e845c1ebedd7067617bb273919b4a82bf3600e3f953 |
Close
Hashes for kgdata-6.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4646e0083a79d41f2e0704b971621a0e631d36211e73c9e5f600554b9a407c2b |
|
MD5 | 8675f7fdaee5ee0e27e7e9df2344899e |
|
BLAKE2b-256 | 3e2308cbc9d355eb1e08b461ab063947bf6ab54396226dafee82530ebf8fbdd4 |
Close
Hashes for kgdata-6.4.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 53007ee98a4b9c0f2cf2f2a0b042e20e5aa82613fb3872e42def5abfbc18479a |
|
MD5 | b9d8cd47e5aa102889a573fa6a8e1d97 |
|
BLAKE2b-256 | df42e1f886ef552d7a78c64f4bd2e5ead9704a1d1a77638b6323d59ceada23b3 |
Close
Hashes for kgdata-6.4.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba0e1f35661ab211300e4a18bcdf3b34f0ce081e90ef8c01b5115ba8aad1c88c |
|
MD5 | 58a9098c07630e38d1e4d9954d2c5b72 |
|
BLAKE2b-256 | 7893f669bdeb27ac54dfacbb63430a3f97d8da7830c5076c850dca26466ed7e5 |
Close
Hashes for kgdata-6.4.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a443547ef0431ab9d9351fdd331e0185227e6e85a43044a0be8535a70965e386 |
|
MD5 | 1e8a45177f5801265f8d1c909fe5bf2c |
|
BLAKE2b-256 | 1ef371c870e9bf86a47d3c800b9b7e8a8915cf1dc7deb0afaa37be720464a32c |
Close
Hashes for kgdata-6.4.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2085dee530c3eba32db13783a01a07e2d7716667cb528f02b257b067e0fe0143 |
|
MD5 | 2e7b90aab0cf6f53ddf6389249d498a5 |
|
BLAKE2b-256 | 6f1fd42629cca152eab45402790984a1fa1d17cd7bdfea9182f275392265efa5 |
Close
Hashes for kgdata-6.4.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e30b5901086698f2554c6fb68a1e79ddab2588ec7226c7ebd0f45551fa362e45 |
|
MD5 | 4d1b3e5c1ef36a3aeb5ef2a7e4a4981c |
|
BLAKE2b-256 | c451a58b5756d96d891125edf982d5f459da51e39d68dfe865502b80ad7c7708 |
Close
Hashes for kgdata-6.4.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af08759d54634d14eb082de7c907e764c2518500158d364c848d2fc7259da9a5 |
|
MD5 | 40836e5da2b6f0328675c117c8cfce43 |
|
BLAKE2b-256 | 5abda241d3d1f4a63bff836d50f1909ff4865b6f05b799c3f6466b2598182b32 |
Close
Hashes for kgdata-6.4.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3df0a145c15457e9455ffc7cad8f324df60c6605752b8b1a0e0c8fb2b5773cba |
|
MD5 | effd968c47afc44c7b09bbdf5568b6e7 |
|
BLAKE2b-256 | b40e87faa0731f474d545da3d1c3b6007d2996c729367776eb0a5cbb44071647 |
Close
Hashes for kgdata-6.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 23111d503162313fd67c60e4aed2c04a8441b3258ed60c349578d040272ecadb |
|
MD5 | 68b96f03651487ebc08178c5a87a3e09 |
|
BLAKE2b-256 | 356d1da06138f99555653b90fd58550613893a06d620b25853cbab275798efa6 |
Close
Hashes for kgdata-6.4.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1f477a3a3bb20e74fd2938aa4011cb19de120c2af85b915e672b4254b1c3f115 |
|
MD5 | 188415acf886dd7fe01c0b472709065e |
|
BLAKE2b-256 | 1b796c16025f9878edd3c8e207ab1770195e1478a8bcda2e9034bec670b98ed9 |