Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.4.0.tar.gz
(139.0 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.4.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d1f89962ab35f757f7b28f19e91adf28f1245a1297ab10304daa1d59cfa1d54a |
|
MD5 | 68877ea20ab7edf6b53f69d8325cc235 |
|
BLAKE2b-256 | 3be15285b23da6371ff78f23e91008dc4060e85d582f270c6185f16d46c18916 |
Close
Hashes for kgdata-5.4.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c8b624c03d6b37b07efc1d486741f836f8b1bd566e8175f1103dbb8bd759aa96 |
|
MD5 | a5bd128538480b99fb9ed64a757b4497 |
|
BLAKE2b-256 | 03142492697fa25d57a5d765b39c18d12fb1a7e029f210f40fda168f8977bcf8 |
Close
Hashes for kgdata-5.4.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e8a9c27f2bd35c27944278a036cf38b9d10b9f788d0be1c92439e5527708b73 |
|
MD5 | a3116b98b30a6e87c8d20c9ad80abeb5 |
|
BLAKE2b-256 | 3c5ced9e213b5578b501bcf0961f160cc50ff32799907fc28585f118db024975 |
Close
Hashes for kgdata-5.4.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7580fd00c416d19d5fa351446e564342ae59d176419c6d8226aeb1ee5e694a12 |
|
MD5 | 07a8ef0b72b6689870488f26a4ecfcc1 |
|
BLAKE2b-256 | 530f8596f4a70cc9e835d2dd2474063ff0c36d203e5dda901866725db6b9fc51 |
Close
Hashes for kgdata-5.4.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ebb0246d07586eb1ce86e895b605462f24bd45151f9005bb2b0061e001f6fbab |
|
MD5 | f254883f5ebdd3f8b050355fe6ef19e6 |
|
BLAKE2b-256 | 70d9794b57c795d6ebb2b4ff924ab0594cef8e172ff2c3ac1ed4953413061db6 |
Close
Hashes for kgdata-5.4.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ba4fbc50e7e39eef3d63ae87327623f149df7001b219a25254fd39809f760c5 |
|
MD5 | 7677e80b142376a1bd6de9c6bcdf536e |
|
BLAKE2b-256 | bbbe6f6f0f5b9a629af46dfe175e166301d0b04b3586b85c6e448ccea5fe723a |
Close
Hashes for kgdata-5.4.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d859a8ca3457644efebd52551d14931352d2f38fd5dc2e6328028386562b04af |
|
MD5 | 31c561b9574092838bcfb0c104fea327 |
|
BLAKE2b-256 | 827c4a4c5323a803bec6b3409d35af569d5f9929f47c51444a32d5060405621b |
Close
Hashes for kgdata-5.4.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9116f64a423bd3558e3222ce246f674a0eaf5a3c59336ace8f8e62d1595ac9f |
|
MD5 | d224fff119b28a088bc1e307ba57c232 |
|
BLAKE2b-256 | dcb075d426c6e89c74f41757e0a48df7d9c9f45376cad426c7615374af02ea57 |
Close
Hashes for kgdata-5.4.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c43732b906bba00605da8b0b5ea2422fd1c3a47a38338b5175bad767816bceb7 |
|
MD5 | bf58006654d7749cb0011c694b4ef262 |
|
BLAKE2b-256 | 327a9c4344b5b0b7b45b12fc03e9ca5a4079190659b480d18c88c4eb26d9a662 |
Close
Hashes for kgdata-5.4.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 04446a787e118a45f70e7311d0b9a55688e3cff157c1a54a8a87b264c37d1d63 |
|
MD5 | 2601b23506cb2952bf1b68170b6e4a62 |
|
BLAKE2b-256 | b51783ed55e5e03ea58e9215781a20f5e9be4d8848760930401f5fddcab2bb39 |
Close
Hashes for kgdata-5.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c29dc1533222c6db89e9c34ac3ab9553ab94cf335b3c656cde94f903d942df51 |
|
MD5 | 9bb9aa43c13999b5c7e962cc00edea62 |
|
BLAKE2b-256 | e3a6759947adf107637f1651a9dfedf3e588113c779f07ce6493834ecb4a3218 |
Close
Hashes for kgdata-5.4.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0f4ee34f8238152f534d16d1efe4cdac997c13d719e70f6a5dc1db652b0c3d9f |
|
MD5 | 7d323554b2b31da5e0b085df787a231f |
|
BLAKE2b-256 | 940b66770d9b54a25ece7b21cee1d47c3d89b5f2848814507b4b8e1fbe42e176 |
Close
Hashes for kgdata-5.4.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bc606856b2c92c8b782da54e9f4201cb509978fcd785b95458465b594a9b8828 |
|
MD5 | 37e63a25f29962e39e73853b13c683c5 |
|
BLAKE2b-256 | ac19a03f1d827fc4857f478448bc6aaf00f5c5eca005d06b800278593055136c |
Close
Hashes for kgdata-5.4.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d829e2ed649e304eac9c1d3eebc5e7c956a6f208357c664192f9d6a64e21a25 |
|
MD5 | 9397132862f37ef343ddcd44e1d3dba7 |
|
BLAKE2b-256 | bc42036342d33a4cb78bdb812685e9018a43fc286d7f4b195a831406d18a7f1f |
Close
Hashes for kgdata-5.4.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1530ce964a755ea75cae4b93065f404de483a341351b56ea6bea33d61726eda5 |
|
MD5 | c45452898400d84c86168ecf16d7f7b7 |
|
BLAKE2b-256 | dd88193e26a6327a823c18381754051771c0b73f1b14904f3dbe98ef3e828088 |
Close
Hashes for kgdata-5.4.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 67615c21e0b670a34b08607111e11e61b6bda212b443284060839cc9d192312b |
|
MD5 | 7b18ff217014a33c8570220903e8eaee |
|
BLAKE2b-256 | 9e284754e09dc032c7c87b62a0b44974def123ade19a39179ab263409a18dca6 |
Close
Hashes for kgdata-5.4.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f86bbe65c3a1f2663b614eb99492215e7467f29e708a36d2771a7c04c91d88ef |
|
MD5 | 8b6e8ed3bb3d836df39884ab811c913b |
|
BLAKE2b-256 | 1929ad376bc9334ad843ffed56f1af3c1f454996532cf794e478fa4efe4f368b |
Close
Hashes for kgdata-5.4.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 230cd7ed46c29002e622009ca8998563e880623ea0e6b5f54ff90348aa0909a8 |
|
MD5 | c1b49d871d31fd655ed447db51776e6b |
|
BLAKE2b-256 | 19bb3c6ce1cde597b1d4789726b36bc8df41d1b58e5a8fa2e5f608ca56cc8e8d |
Close
Hashes for kgdata-5.4.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a0d2b382c794218221a975fa08f0c404dc5e9f7dbeef014fbd84c1ff47376f15 |
|
MD5 | dce24a4de00e1f1a5d66d13bf8f62f2e |
|
BLAKE2b-256 | f26c4954b6b3b71f1cf8e08ac88d44134c532b665704cb5bd076538ada1cb9f3 |
Close
Hashes for kgdata-5.4.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | dbd3e38ef147231ebb51026681e728030017aa6ea8af7db7c80243b0f692714f |
|
MD5 | 7694d2313fff76ed2742d9818949042d |
|
BLAKE2b-256 | c6d1d583158a46bf038bc3e87c62c1e7cf15fec2e0f8fa02b0f74e7604aabcfa |