Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.0.0a7.tar.gz
(120.2 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.0.0a7-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 30aa0b6acca20c988a1b494156ac608b3b89a233d3591e95df1a7831ae72ed98 |
|
MD5 | cfb91527c0d22c4a933b8a93e6cc4b62 |
|
BLAKE2b-256 | e1c44cd68d4d2ac76118540159940095882fe9a6512dc9e99039cdc845ee5882 |
Close
Hashes for kgdata-5.0.0a7-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4d3b7fbdfe807be36116f4b88bd0f573ba4837bb9099857e839c4979956ae09b |
|
MD5 | 8a992afa2fd8db1a954085933c643c72 |
|
BLAKE2b-256 | 616770af3d66d393765eee146fe5eb2fe6d3685d5888407fd6943a73f6c56eeb |
Close
Hashes for kgdata-5.0.0a7-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fbfc36c938fe40798739ef4b4c056117578546a229cff4793bc954f16b3793c6 |
|
MD5 | 7d2f3ced6e6e84b85cc5544dba2d73a7 |
|
BLAKE2b-256 | c164db78e92f56db8ecace0d926664a21e72bfe507826df9abd63f65045596da |
Close
Hashes for kgdata-5.0.0a7-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 45efeddc7c392feb441b6430a9db17742483457c40ac8a52a4cfe588c52ec54e |
|
MD5 | b6cdb353756152bd9ef9e70ca5b5dccf |
|
BLAKE2b-256 | fff9499f7949ac288aa932bd148a060b169ae27c37c7556a9e5fb4b433f2cada |
Close
Hashes for kgdata-5.0.0a7-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9799d6be2acf35f6dd4ec1eb45ea627e600939e7da6002a7db8551f800c720af |
|
MD5 | b9631c6652019fc44df0c9a62b2fbb7a |
|
BLAKE2b-256 | 482f61fcae2e3aed99bdec050fd40eb6a8399b18c77088909c1414573ceac4f4 |
Close
Hashes for kgdata-5.0.0a7-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40b77b8225b14006d0d109584511a6268cc2690bdc8074d886dc2c7f7501e76a |
|
MD5 | 3f20cd2431c9d91db813cf1c94794c14 |
|
BLAKE2b-256 | ff3487f2135c0be6b714f4f80814e3fca94afa5edba1efdd912332fdbc20cc7c |
Close
Hashes for kgdata-5.0.0a7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d1aadc9de16678d0705e607dabc5ebf577c6a3ee704291be54183a432c84307 |
|
MD5 | 094e48169df83e21b84351a931df26a1 |
|
BLAKE2b-256 | 6575704d839f087c0182712bc91793d64ee3c8f456031ae11ffc1cf88e488c64 |
Close
Hashes for kgdata-5.0.0a7-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d899280cd095a6889eb06a10d5709d08b38a639521ef022ebcf221e3ccc2d4cb |
|
MD5 | 5a5c71b02c7e655ec212d659e8f9319b |
|
BLAKE2b-256 | 660bf1d2135698392dcef3d7f34b585f7eab063bc6aad80ade5c145cf6ab9495 |
Close
Hashes for kgdata-5.0.0a7-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5e0432c78186c400a1eb58d9f3ecc8fee11cccacb4c510da801f8394c8fcdf6b |
|
MD5 | 276b9d883a005557bcdfcf1e3212ba5e |
|
BLAKE2b-256 | dd967ad5b40cf3af0bc2d20414f605318578c35b81ca8581365a681bac6370cd |
Close
Hashes for kgdata-5.0.0a7-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6fa29bea70258d75d3b0f582e997f06bf9298883e3d707cd7060856e9c565aa1 |
|
MD5 | 18398088b3c18fe71a0f4457f1ef16f1 |
|
BLAKE2b-256 | a1271dd6dc38cf8f85e1abd7c4d8e570277dad254662d97ed6f382f53bfe5cce |
Close
Hashes for kgdata-5.0.0a7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 849d75485f65f0115b67b13ebd680e302e3591999a730c4c5cc33e0bc82610e9 |
|
MD5 | 3b1ebf210eac872a09e9454c47f6fe11 |
|
BLAKE2b-256 | 1d73b4df4f70dbeb79a44243e97f1415b67ceb606c3ba3fe654ca23c7c326c87 |
Close
Hashes for kgdata-5.0.0a7-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a88e09353800e712dc9917c16c1cf2c2e7c8508650cdceaef7a1aa580a6c56c |
|
MD5 | 37760dccfafef5c45f7e59249f4a2fec |
|
BLAKE2b-256 | e91788cbefaea3daa135525504c251da854e39af4868f9e1bce24ec1531cd6d4 |
Close
Hashes for kgdata-5.0.0a7-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 824aec76c4c41861fc863103e347a13cff15f9704c817718bce1a071a05718e3 |
|
MD5 | 82ee6e8bc48533eb8f5ca5b3b7ea0cf4 |
|
BLAKE2b-256 | 7df13f06c089cf33071143a1da8549238e624751ba3768f0ecfe404d486a06f4 |
Close
Hashes for kgdata-5.0.0a7-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b77dee776ed493aec101599c6d5f7483587cfa8b3d47a7033836e18bc874539 |
|
MD5 | 9b18f6798201c5d47b2ff49a42acaf74 |
|
BLAKE2b-256 | 0bd81e2ddce893ae1f697b4bd885185d6078bf243e0cc8e7585a6025eff5d68f |
Close
Hashes for kgdata-5.0.0a7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a570e17d6d44b540cddb104be792e5183909a251688ca8decff99c75999ab4f0 |
|
MD5 | 8761822d450673553d2b6991d85ee2d2 |
|
BLAKE2b-256 | f5cbcafe2d6538533704c8f667d8a28b1c1b645efad1a3e872e353863aaad394 |
Close
Hashes for kgdata-5.0.0a7-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63a4b88449eb29bce979c723354761b1df499293e4b034161ee2124645c895a2 |
|
MD5 | ae288295519d6330e76a1c7a1940133d |
|
BLAKE2b-256 | e87c79cc517fcfa492c93af04f80c625857ee94f0ea16613fcb3e829fa2c302f |
Close
Hashes for kgdata-5.0.0a7-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ff6e39ca517e0da87acd2b1db68e6b2b559423fdfafb537cf0d37c2dbc43575 |
|
MD5 | deed3707e1030b67e3be6e1d0226e225 |
|
BLAKE2b-256 | 371778bee524a2dd8f0af693ccac36377bf231fe28f88157be6acd9c2ee4f7d0 |
Close
Hashes for kgdata-5.0.0a7-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dff72d42f0f3495ff81306d8620a4e1e58a4861c05e58a18d3b23f0cc523829a |
|
MD5 | 0ae847684486645bdb49bbe0f47dd6bf |
|
BLAKE2b-256 | 1b40a58c5b51df406bf45eb838eab631e7fc73b22afd0ca93bf7ff2359f2e71e |
Close
Hashes for kgdata-5.0.0a7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d3f3077beb68c011b3fada2a42af3e9503aae67c5c97dbc83a8566dbeb533215 |
|
MD5 | cc5b7b5037420ec5c5f3ecd9597d3fd2 |
|
BLAKE2b-256 | 588e4b38c1d442d61d27d3ca90386b254600eb4775dcff4f006762533d45c2d0 |
Close
Hashes for kgdata-5.0.0a7-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f13533c0fcf8cdef26d845cf2677ca00aed96980ff1c1ce63b27d5c8b08a951d |
|
MD5 | 6bfc24565b80ef88eb4019ddb0276811 |
|
BLAKE2b-256 | fd7604987a837f7a9716aef7bc1541efb768ff2006f65b5c717a43faad485833 |