Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.0.0a9.tar.gz
(122.7 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.0.0a9-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc5295afc6bedbfbe54f8fa7d4bdf57d157188ac87b0df99640996bae7900da8 |
|
MD5 | cf7d1eb94b9cbdfb84656723ec384659 |
|
BLAKE2b-256 | 21847ee79daff9f05f22e5e51641d9a776953d6568cf5b8f2931f78e1e184235 |
Close
Hashes for kgdata-5.0.0a9-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 871388994b885f6b1557c64b2f3c270bf823e3f1c7b0084b51b7d5ef1ca2576f |
|
MD5 | 259db5e7987d2c3abdf46b02d9e7a912 |
|
BLAKE2b-256 | 3e91d22051b4ee953fd931b892194c36db7f23fb9699c15a1f68f4736cdacc7c |
Close
Hashes for kgdata-5.0.0a9-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 968d9306aa7da1794b085d4a53e80986be133e1daa695aa25488fd778309f950 |
|
MD5 | be373df7b2864cb4ad066f4d731f81e6 |
|
BLAKE2b-256 | f9455893fbb6bd52ffe7b4df1a02d90069083f8751579a88d850977ff5ab6518 |
Close
Hashes for kgdata-5.0.0a9-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f57ebedacb74ff3c959e8b738e32e811902b1680d41c3ee8ca86442ccde6b3b |
|
MD5 | 95e48fd86e915f8a9e4e3168b781bc75 |
|
BLAKE2b-256 | 2626f009b79b8ff1169d5cd5e3290ffcfbc9a38c8d9297df29e740508d8aeb5f |
Close
Hashes for kgdata-5.0.0a9-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7affc6a4b4e7f310d2c638e9ecd932bf93b6a6298910f4c731e47f85abef1f43 |
|
MD5 | 796c7d5408cb7d8ae1e3942663004255 |
|
BLAKE2b-256 | 3ec9c1d4a46a005e3678804b20cc193722a1f7c1a0d4f7fa9dbdaaadc68f2554 |
Close
Hashes for kgdata-5.0.0a9-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40ab13e99b90a59a38452772e5e08223d28a94a75ac85dd99669e32f53f25a2c |
|
MD5 | ad549abda0448d3c1c3553af967fffde |
|
BLAKE2b-256 | 7376e0fcb6492be038b127160722d67620d6f1d85d50bec32e54d0e4d665f7ad |
Close
Hashes for kgdata-5.0.0a9-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 45ebe3869e75cd0c1f7402fb23c5fe5ebefcd3d65ad6bc52e6688ad7d19bf9d7 |
|
MD5 | 96b4783e4bce8463cee27f112cdf54af |
|
BLAKE2b-256 | 8275a53ad3c67ad169ac0557779e0d3b6b120d2b6c793e449bfee346ab36d3d5 |
Close
Hashes for kgdata-5.0.0a9-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a8545602ab2a0c7b4f418ca8ac3a35f374a1afc0edde2bd9a600370b05d1a3f2 |
|
MD5 | d8c9845e2dc6674c15c5604e56ce0e1a |
|
BLAKE2b-256 | 888711ae9fcc7861ee4e14755d1ccf6b1787ae52fee5ec1aa6e9cc22e4a3aeac |
Close
Hashes for kgdata-5.0.0a9-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 715111fa3f55e75506111cecc2d060930c6baab9b08d480ac6360b2a95988ef5 |
|
MD5 | 4739f9cd0a88f957e17ef750712e7ab4 |
|
BLAKE2b-256 | adda2a573d27abf78e5ec9a89c150676f789aa452452263d94dad61c0172c683 |
Close
Hashes for kgdata-5.0.0a9-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e4b52fab0f406f0d7c37ce93a9bdaecb8fcf92e8072782e28f2b45f750ba14ca |
|
MD5 | 10d5091947bbb792864baeaab1550f53 |
|
BLAKE2b-256 | 4dc883476f42dc9ed5839602f0bb74018914d133e5135ac5c173dfc4ce7db3b5 |
Close
Hashes for kgdata-5.0.0a9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3bc6e0840ad0716d3fb81376b87e8682069e9b7d09cc88ae5491a72b25f55e3f |
|
MD5 | b9d923966d5fd9784935244140389f17 |
|
BLAKE2b-256 | 349782d517ffb53e64b8c72fbd7e7fe525057e35f0eea190a1fc4d2271fd0e17 |
Close
Hashes for kgdata-5.0.0a9-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3d5aaa1ef01db0cac92fee47bebeaf60a6f6debbda37d37c5767f634350ec89a |
|
MD5 | 01b6662371e2ca5436b75aedcc880a9a |
|
BLAKE2b-256 | b3fb613a6a7611fd0c425a99bd31494a72bf22408d21ccfbdec1b87bcf63493a |
Close
Hashes for kgdata-5.0.0a9-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 081d2e1c8dcf869e4b8d4c12e70324d90487d2e3b6ccfe6d6399dc7f6e88e0e4 |
|
MD5 | 3bd4a2feb35259674a2f0f4ff6f4c359 |
|
BLAKE2b-256 | 93a361cd281ca3a05a41fca346bf988e8043c263aada9f747a3ed9ea4c23f3d9 |
Close
Hashes for kgdata-5.0.0a9-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77d73fddc3fe5fd7082b28c0b3905f11e12d6df93157c2ebced23f9f682df633 |
|
MD5 | 2440ff972347256d232ba88c3137a422 |
|
BLAKE2b-256 | 81b57d88feef529c6d41515f48e84a8610b2706f9b5f4cd78c81160f98c6dafc |
Close
Hashes for kgdata-5.0.0a9-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 703393442f5f094c4c04e577a408bbfd947ce0bb1db2189bc017ef4e5dd39ff6 |
|
MD5 | 083102d3a61720e9b4d8a380c5ec561a |
|
BLAKE2b-256 | 3536fefc2ef64acade6a8e2ef0691de4eb8914ad29f959cfdb5fd8731498b5b5 |
Close
Hashes for kgdata-5.0.0a9-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5a3c509a372be973280956e019d8ee2c7c88dbd131506cc65c83649c1e822c7b |
|
MD5 | ab1e3aac29b2505cece5a88631b8007c |
|
BLAKE2b-256 | affe5d7c5c128a39fb4a49f89a52ce44c9efb913dbf61154abcc9e3a8e9d5314 |
Close
Hashes for kgdata-5.0.0a9-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e40c238e921100a624706066ab389580162f61cf683031cc962781589d33cd52 |
|
MD5 | 1219cb9f80ee3be2f5fe43d194e4947d |
|
BLAKE2b-256 | b10c379117e46101072f4e2e4817234b3db3b0fdeafa16a175433123cd6b23a9 |
Close
Hashes for kgdata-5.0.0a9-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 832c1937e13ff6565a84f1d13aa62a3223836f4e455b6d61995db1a3e4581f2c |
|
MD5 | 5636f7a0b58942725ac9372631eed794 |
|
BLAKE2b-256 | 193b004c8c0d65d6aa56c98b36435c6264f6bdfcda51fed909766faf1a75b4b1 |
Close
Hashes for kgdata-5.0.0a9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3492875b67382366e4746c8078e62749707e69d125c8f1bb027844d6b99ee0d8 |
|
MD5 | 0d05a9327d42e83ba8564436ccc48932 |
|
BLAKE2b-256 | 438323396f1b288bd7eb13605d9a2716cc4c8f1d91b08ebc6fae3f1e08b1357e |
Close
Hashes for kgdata-5.0.0a9-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bf6e2182841132383da90a05280ab7f2093e6220c885084a830401db1b980ae9 |
|
MD5 | 367fcbd891e254b65a2aa89aa6db186d |
|
BLAKE2b-256 | f3a56b8703375c66e7c9d6d89693f4362148d9a7732e6601b0b53bdcb16961da |