Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.0.2.tar.gz
(110.2 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.0.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | afcd57367d136ada442466a16aa76744d2f5fe15fb72d6cca6be471b451de331 |
|
MD5 | 1d8ea29661027b7d95d538a6499610b3 |
|
BLAKE2b-256 | 1369a551c0e6da92ef28ff3b839a33fd76e631ef340527331c88fc4d929ecf80 |
Close
Hashes for kgdata-4.0.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c7f91932ea529f30f82677c231608fa8a81e38aa148b6c35f75d5ffa643db30b |
|
MD5 | 46fba0beb142aa3e532413b89d1e027f |
|
BLAKE2b-256 | a210017e3d7a86a0782694a7f9271eedaf192f515dc93d93700893e35cb16ea4 |
Close
Hashes for kgdata-4.0.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbe049f16fe7a491ebac64301ab6e847024cd1a53f328a32e901906e36b7a90d |
|
MD5 | cafef73790737cadad315cfe63c3e34a |
|
BLAKE2b-256 | c56620390ac840a803952d3c5377dbac9a527c23ff83b277512c5df035333d78 |
Close
Hashes for kgdata-4.0.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e1b46a21600d0c477cce618254800d5699c8399b968d0de1eb56563fca39564 |
|
MD5 | 7ba90148a46b5ac54e0caa02e9aa37a6 |
|
BLAKE2b-256 | 27cf80744cff512947a392a08c4e32ecd237656ba00c1d60516ec7276dbd01b7 |
Close
Hashes for kgdata-4.0.2-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | eded68fa60c6df5d92f4060b6ca24746b75d2e61072a42887b750d5cddf8b6ef |
|
MD5 | 43f899debf7d8ce28b5411058a55ab09 |
|
BLAKE2b-256 | 053caab31ee61bb3e8bb82c4ec4a0851bf96c9c0eea6608986ddbfab2e83a680 |
Close
Hashes for kgdata-4.0.2-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad57bf0a3741c30a5ea31d39c3a24c55e37e677fe72817f2e933f7d367608d81 |
|
MD5 | 852b8f6bd1d52c1af8bf0944e4c781b5 |
|
BLAKE2b-256 | a248f760f3a698a39525d537c94cb9bb66204c16a85577f6981f8a35644f049c |
Close
Hashes for kgdata-4.0.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fee4ec139424d327f410fe1c992a2331358764b11126e311d62ece1fb1f87a11 |
|
MD5 | adff91449f72aa09f4f5f7dc153c7891 |
|
BLAKE2b-256 | 964cf439fba75dec6e14435c6cb6269cb39d115266cd74cd104d3a43384fc1b0 |
Close
Hashes for kgdata-4.0.2-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 83187acab9986b1abf689e1616a52f987f7af46e62c18e34a6615f241fe5dc6a |
|
MD5 | d395a8d2d15d123c59ecbf5caf79c57c |
|
BLAKE2b-256 | d7db0489afab87310e0e5c237fa8e33175090a7dcbe2d5a57b13990b0c2bade5 |
Close
Hashes for kgdata-4.0.2-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4ad09ec9ad2153abbc916163006fb9c26d98a59956a52e0a3390521e00d43168 |
|
MD5 | 42f87a125e083a6eda9eccb01cb2a184 |
|
BLAKE2b-256 | 5f0122f5789dcb3cc0ecb33e601f278f6e6f99793e24834f5b9bd1a4927a8ca9 |
Close
Hashes for kgdata-4.0.2-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3661359a2fe96484b8f6fb523395fc3bb3365b348134bfe077d5e713a8fb4519 |
|
MD5 | 02b08172cfe395d17820986d497d4fa9 |
|
BLAKE2b-256 | c478fef6b3b43e96877624a9631bd59908a99ce509c9b8cb690fa59303f4f7f8 |
Close
Hashes for kgdata-4.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | accea7000090455ec81d7d7726a7647018e101cbf5f5cff6b9bb3a722f2b1542 |
|
MD5 | 6cf5e24f8d2cedde90eb9f7968c67577 |
|
BLAKE2b-256 | 5b246198d673cc5fe866bfef4af8134c153ea29af33fe68a449c2974a4fb4a56 |
Close
Hashes for kgdata-4.0.2-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8d200844e2e2032dde92c9e30ab4cd7ca8d56e5ae3efc0bc21478e2b929a647 |
|
MD5 | eb58d767318fd3b5d784b68ffba9bc5b |
|
BLAKE2b-256 | d98da0110ac204940608966693efdf201080a745d33d3de81585a4eb719012d7 |
Close
Hashes for kgdata-4.0.2-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 174bdc45f226e9379786564027ce327c18f2b7a013518dca526bfef85d8c2432 |
|
MD5 | 9179938d4656ce55445de26d51824dea |
|
BLAKE2b-256 | 502975b33905caf65289a46fcee0f176b37192d9937234868592dcd3351e21d6 |
Close
Hashes for kgdata-4.0.2-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0d5365ec45fdad60de9d181420e6e63c558e9963c22cf116f45683cc117d6331 |
|
MD5 | 9f73b7da45e2ad792f253a05490343d1 |
|
BLAKE2b-256 | bcf35214053ab074a15887ee016b01c26ab0f6b1ffaf2ccb7136abbb0fe34b15 |
Close
Hashes for kgdata-4.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 61e6c07165fe01d816cf8434e5ade5e25245a4399c36b1bc97946294f5ad806e |
|
MD5 | 47020cb356de14017687a79fbd219d03 |
|
BLAKE2b-256 | c983673f2a9c49339d8272845f2cf3c82eb9c4e93505df09cdf620cd85adc05e |
Close
Hashes for kgdata-4.0.2-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0713f4c26415c53f16fcc31f985cf7b17073fa907fa203f85d3bd861938ad8c1 |
|
MD5 | 511202092958ed811e8b8f9448453b79 |
|
BLAKE2b-256 | 7bdb8ef5f01ac4d1e8391c7116eb9e816f0a3e1af1d3a8abd4a57d32346b2d43 |
Close
Hashes for kgdata-4.0.2-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba22dc1f053c19f5e017fe3083fd526b31bb65164dc7271ff7da89d4337c49ca |
|
MD5 | 3c5322fa33361c2453eb936d04d659b3 |
|
BLAKE2b-256 | bb74879b670441fc7e817b3f72b07b0cbb5bb951213efea9ca3f724b948cb857 |
Close
Hashes for kgdata-4.0.2-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 29fd46a2fd602c3e0d2e532c8c6bbff86b114be8419ebde5457425bf49c25285 |
|
MD5 | 9877c8ddd4fb1897a89d38582ea751d6 |
|
BLAKE2b-256 | fa9c7b75a99437482ea4fe374fd15af09e2f14e7d8f7689ad2e9bc8d2b828a1c |
Close
Hashes for kgdata-4.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 970113b688b3c382e517200063f35406423cc73e05c1839b2af83e825201a04f |
|
MD5 | a9e436a05970f4e22a82d50bedb18421 |
|
BLAKE2b-256 | f4ae7b720cfddfc46ae46f28b90c807e1b78f26dd61cdde0d07d318c144fcee4 |
Close
Hashes for kgdata-4.0.2-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 08623b73d121421e91597876431929ce33e47620ac3fe7a314fa7f0b457cc290 |
|
MD5 | 566b2a6685cd6400f28e0e70bf3c94dd |
|
BLAKE2b-256 | 4cc67abdbf37bcbaebc67e5d1d16878e0f8558374b5e360aab70a0546554fdb0 |