Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-4.1.1.tar.gz
(115.6 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-4.1.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 971cbbab9bee2e32c45eb8ec14caef4c08b8c5c2ecf656b62a9b3acc88346d6c |
|
MD5 | 01e06aa5c51fe188ba67c012bc9a61a5 |
|
BLAKE2b-256 | 78b1f082fc733e8e4008d6af52711c991d237a4ccfd5e458b181b652e6313a15 |
Close
Hashes for kgdata-4.1.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78376fbe2f466d974fe1751af14f44531a537e0daed80c2b201209eb8f0ac772 |
|
MD5 | 4e9fba60fa25d45b257d308374bb985a |
|
BLAKE2b-256 | 005b6ded328703a402593bbfb7977271d58273489b7cda0da936c9b6ad986885 |
Close
Hashes for kgdata-4.1.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6a0681540cd61700b2217583fad12eece09fc552f706ec6699e74769c02b922 |
|
MD5 | ad745f76174addb5e647f5e47dbfe117 |
|
BLAKE2b-256 | 2ffc55a7d386c0d74e3db2a5c780d78706bcd16ecfac7152363af50839ff98fb |
Close
Hashes for kgdata-4.1.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 92f39809ca9cfc3b2b580cc28f07c5e7b4790029c9e9663469f510cef883ad2f |
|
MD5 | 7aff5297bbee5b284ef6eeb21108ea0d |
|
BLAKE2b-256 | ccd66388706efeb26aa6fbe24ee12ef326ab4fe3bd3918eb865a827c3f3d0715 |
Close
Hashes for kgdata-4.1.1-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4450a4dafdd4f91b17e297794382457e866d4a7b570c79abd090cbfa95505eee |
|
MD5 | cb0bbb5d5bc1e8926d4b9baaa1fd65c5 |
|
BLAKE2b-256 | bf3d61413dbd55392e14cce15903d0eff2d2e39e18456547bc2a926950fe4aee |
Close
Hashes for kgdata-4.1.1-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84db10a282b2a8174a99c6cf35180e72b1c64f7905aef5ff9d420ebcf79c760d |
|
MD5 | 0009fc862687f4fd4930c72a10b8ae66 |
|
BLAKE2b-256 | 5749e5f7ac00331f184ae92b0f7d58260357cb8a68ac91a54a1888e1324ec087 |
Close
Hashes for kgdata-4.1.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6df853a2ee86fa4b69664d95aa9b4f2618e64a4c1d7571908c02208a8fa9bbc5 |
|
MD5 | a38513ffd09f6a5119bf4c0d5d92470a |
|
BLAKE2b-256 | 66435177cc621fdde890db69d2d33408c61f0873c2448ea5bc4137d406d5ef79 |
Close
Hashes for kgdata-4.1.1-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6396b8292347ea7a07274cc317907c05ee44208b822d027c71902c300146bde4 |
|
MD5 | bd38f44d9bef899345aef5d381f83145 |
|
BLAKE2b-256 | 77045ad45f50afa4bccbcc3c769324585043799f3e8eed9f1c24d68079256f41 |
Close
Hashes for kgdata-4.1.1-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 80d4fd5a0b64f982cbdb34edd2f506db54aa3c80c5920dbb5bfacb1fd14cd60b |
|
MD5 | bf7a5f306f1b6c32306dc3b9335e2706 |
|
BLAKE2b-256 | 9fea479f803956618e54d755d03669bb931423c54cad8e01f4fe880ffc9481ac |
Close
Hashes for kgdata-4.1.1-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 383aed7313cac01beefed487c7e0e4db579682b16a2c9038f900ae5b2dc839bf |
|
MD5 | b668e51b12a078c9c0e81c79104f7be7 |
|
BLAKE2b-256 | bd7d357aea00c1fb13eb1b30d9f50e45b369acde0a24bf853b8d7c6956ae8a89 |
Close
Hashes for kgdata-4.1.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 128970f44b7294b48b023243e4456a362298d9726d26ed62fe3310e2e88410d1 |
|
MD5 | 5f1c28f8a1ecad78722f68311d78e7f0 |
|
BLAKE2b-256 | 3b29c25e1114241028ec01c74c33e41abcecb9ef4a55ea403355d75713f5a653 |
Close
Hashes for kgdata-4.1.1-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e5ad897849827d5446cac7201e17ea06a28b7a9facd5f3037008fc3e8779a5f5 |
|
MD5 | 8819d8473fd128f022ce2b54098bd474 |
|
BLAKE2b-256 | 3599516ed1156c94ab24edddf64e94fc28cddaa34250b86873e8b929fc428d5d |
Close
Hashes for kgdata-4.1.1-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd48c4c9b054b36083aed3282d9737c9c058d36d4316ce9937db60f2ccb825e8 |
|
MD5 | 366dce5b89c58f2f11167da65b87018e |
|
BLAKE2b-256 | bb5d038899bff5dcac1706d9fbce521ae729254f130a7d1248a321f3639818f3 |
Close
Hashes for kgdata-4.1.1-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b987469ecf7591285c74665e5b42798b8ec2316452396d615faf2dd39d8a88a9 |
|
MD5 | 5f29a514ed9712c9314c43b97bc07f7e |
|
BLAKE2b-256 | 67385acbcbef1b14a6ea877ecefc9937123009b155c0761a9d36685a3b0c589f |
Close
Hashes for kgdata-4.1.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8b31bc8e9e64159759a36a2019d4eefbab442a0d62bfad4ae9856579e64aa1c3 |
|
MD5 | 90be8ba966f4a46de936cb740be1adff |
|
BLAKE2b-256 | 4585c98cb952687e7da52ea3b6b2d84d8c663b7d59468d3dadbcf4665b1ea744 |
Close
Hashes for kgdata-4.1.1-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4e33b508a6c27f9211cdc07a1f2a564959bf3a21ce5e60d40de32965671c77e |
|
MD5 | 4cc14b277864bee1f426f65544db5381 |
|
BLAKE2b-256 | 882ebc21c303409a73d17ae2b8c9b898435fb111c1a0b995fc6b7d000d045ec6 |
Close
Hashes for kgdata-4.1.1-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8a82ba427496c8a32538ceb4672b48915844d93ff8ed09825e19c9e9411396e1 |
|
MD5 | 4760406947784fe9d09c23b0f7978595 |
|
BLAKE2b-256 | 395704c126294b390c681790376687f189e232e8a9dd495bf245cf95fffd4d8c |
Close
Hashes for kgdata-4.1.1-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4ce898d29fa690bcc975425ed26a64416fbe83aef4847dcc494b59a25ef3a092 |
|
MD5 | d95133b08be168dc175e83e8a67aeb4d |
|
BLAKE2b-256 | fdf2570191aee0b5097869700c9811482f6df3e842a4cd31857cb8f64ed0cb3c |
Close
Hashes for kgdata-4.1.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26b5793f0860e421ed2ea1a02cc20a65fb21fc13571cf581766decc3db5f380d |
|
MD5 | f4b1d9d25244c25095645b4f4bc5f758 |
|
BLAKE2b-256 | 9c67d9cd709b01909fd5a966a57adb4f22b6f6bffcd8d204ce131ec71868d509 |
Close
Hashes for kgdata-4.1.1-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 04b8e023c4100cfed181a100284e11bc10cbbd9aa418c531519197fedf36c962 |
|
MD5 | 878def96162001e51ecc08fbe4e43e74 |
|
BLAKE2b-256 | a380265b03be3ee45eb8525d080b0820a9f20a5141d369a526b956d2b86894b1 |