Library to process dumps of knowledge graphs (Wikipedia, DBpedia, Wikidata)
Project description
kgdata
KGData is a library to process dumps of Wikipedia, Wikidata. What it can do:
- Clean up the dumps to ensure the data is consistent (resolve redirect, remove dangling references)
- Create embedded key-value databases to access entities from the dumps.
- Extract Wikidata ontology.
- Extract Wikipedia tables and convert the hyperlinks to Wikidata entities.
- Create Pyserini indices to search Wikidata’s entities.
- and more
For a full documentation, please see the website.
Installation
From PyPI (using pre-built binaries):
pip install kgdata[spark] # omit spark to manually specify its version if your cluster has different version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
kgdata-5.3.0.tar.gz
(130.9 kB
view hashes)
Built Distributions
Close
Hashes for kgdata-5.3.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0d569290b809c088aa54095fb1227bf6d0c70564ec21bed81dae6a0598da180b |
|
MD5 | c3604c4a575e7638d9516be3745e45fc |
|
BLAKE2b-256 | 615659466c951a02bc9e83944bedd29bbb40a3d7fe10c9dd1871d71a37784403 |
Close
Hashes for kgdata-5.3.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1021e040cbb3a98ec430b4cbe97a215f88e062bb28d91e7e5329fef8fd974f44 |
|
MD5 | 963393373b9676f3616a93600ae7a980 |
|
BLAKE2b-256 | 861065944a7685e1dc6fec91da6e3c843d029330be1dff6c5dcdbc84e21d11f3 |
Close
Hashes for kgdata-5.3.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb5fea936c85eedca2c7adbec7e7ff9418736906807ec3f7fbbade0926215574 |
|
MD5 | 262b9e9ad362dd207303671ba971c550 |
|
BLAKE2b-256 | 579b0d5c3d002eb1d7509124c12cb34fe279f0ad3bb8d3a131d4638afe8e97e3 |
Close
Hashes for kgdata-5.3.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 94fb2442c9233e735b77b41d99e55b7bc1c958897e77fcba278c01a1f68ae4b5 |
|
MD5 | cd9cc44fd12773637f831759ee31397e |
|
BLAKE2b-256 | a30182e3e5b6089d45e4fe53598f5964e80c6baddf51fa21cebea3076940a2f4 |
Close
Hashes for kgdata-5.3.0-cp311-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9a5608669ec06cab46b543182e8eead1ed9fa4833bff8c9871a9c9157fca22a2 |
|
MD5 | 22afe90247e33c55a7e8f9f2d23ea067 |
|
BLAKE2b-256 | 250655dd57137b151a61132a113b9bc0d408fdc09545d731a364a369db6efce8 |
Close
Hashes for kgdata-5.3.0-cp311-cp311-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cfa4b8ba1c6cb69706ca29f9fe1199b9284e54134e699e70f14343ad2002932d |
|
MD5 | 00bd216cd9f292e59060c3f63a14a60f |
|
BLAKE2b-256 | 36e93d86c768319ff259dccea624235a9e82f2a597f65f62da983e227c970512 |
Close
Hashes for kgdata-5.3.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 31b8387d09ba02744c3e04081b92acace3d3d073a2952311dea2d140e98a8683 |
|
MD5 | d40d4045483f60b35331d3b260441ed2 |
|
BLAKE2b-256 | 6e552345db52164071cfa9a46145796440375aff6ba805a1b1e3184382c0f640 |
Close
Hashes for kgdata-5.3.0-cp311-cp311-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d661dc2cf1421ad7cb1105fe508b33ca0d66457deb5638b21d3216fb4711ef8 |
|
MD5 | d57789b04b75acdf8b956a8a607e90bb |
|
BLAKE2b-256 | 0612517805b8418c2f7f11f67619109577fde87e881a1d1ba2560eaaa2502e10 |
Close
Hashes for kgdata-5.3.0-cp310-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41816f94f63ca07b8b487c69274d65cd831381068e4620a1d0b30d5ea7b4886e |
|
MD5 | b1234ca4c01c2899b1dc64aff0d9780c |
|
BLAKE2b-256 | d826886fdf7cf5aa529e16d96c49bb60b46be801a92f5b633b7b6babb8715d3d |
Close
Hashes for kgdata-5.3.0-cp310-cp310-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7902a82a2ad2d95b8c6d74766762abbf721d6e699c8c0095efee42d1840e50a4 |
|
MD5 | f779c5834b2092d85e5deb75efcfc7b9 |
|
BLAKE2b-256 | 191e64fb240be3debe8a46f008ed4c869abbde3457115b1a385f4f6740650f62 |
Close
Hashes for kgdata-5.3.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2106ed52441da6f11f1f82cd2c9e0183bb27f558a995f28d46473cea00c3ffc1 |
|
MD5 | 8281e76e0f31bb474a18febb300da1ac |
|
BLAKE2b-256 | c556fecd7309fcb424b6efd0c304a8d759ecf093b9eb087efe350b8357bad71b |
Close
Hashes for kgdata-5.3.0-cp310-cp310-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e1ac2f26879cc1b663b17eb8d3c3e0544604b844a6e054fe464c4cdf2dfdff5 |
|
MD5 | b3612482aba1af440004659b6c3bb430 |
|
BLAKE2b-256 | f1dc1726458aa36ba0e893857afe670fc10a44470375922790bb54ec97a5bf82 |
Close
Hashes for kgdata-5.3.0-cp39-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8ba7b81c83a0a4d3798f56168e1d3ed829963a0b9e659d125a5f802e801111c7 |
|
MD5 | 5527c0b0ca53c5bfbf95bd96998cf303 |
|
BLAKE2b-256 | 737f2d92359e2bfe5b0efadcbb49d475c348bde7af4c472c79d30b36c790a459 |
Close
Hashes for kgdata-5.3.0-cp39-cp39-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ff2734f5ed48c90b74c8c3607e7c349721a955c94fcd0cd46283bcd2fa4fc83 |
|
MD5 | 8ff6720980fa9c5742cbb1c3cb24f7ad |
|
BLAKE2b-256 | 9265f3d29733e5d0fd0af521262a4cdc6b11c28fdb7eb9a9a799ad8b20144ca2 |
Close
Hashes for kgdata-5.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e8a42fefacd2fecee08ea5dbd5a18e263a0d4589921eb2b746af1b39f08c7614 |
|
MD5 | 08e7abd51b53fd89907223102add2398 |
|
BLAKE2b-256 | 2de11d154ba7edcdd5610bf5e613593cbee6ac25cb6761e3aeaf848ec3a9693a |
Close
Hashes for kgdata-5.3.0-cp39-cp39-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fb0e5b1e2f4ea2c6f83d1bc280bdcc69cf564ebc308163afdf9734155050b874 |
|
MD5 | e142a868daa39a18c0b63049bf95254d |
|
BLAKE2b-256 | 226c7babcd793321ed3897d481c1619fd0b18cc9c23adb7c9169c939c617f70c |
Close
Hashes for kgdata-5.3.0-cp38-none-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 72c00aceb72afce0ea08ca677c85fa4e4d624bd3c401d584ab7ef1268f0f7696 |
|
MD5 | 340cf68025974ce4656ac6ff06ddfb5f |
|
BLAKE2b-256 | 15d1a3a2a09be3e1287248242f7cb80301d5cf96505c6fe7b0f693ea8d90124c |
Close
Hashes for kgdata-5.3.0-cp38-cp38-manylinux_2_35_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed10c54a1cdfec02b2b01101cd4de426ac1c00606580a2bf89dda1d6bc15ba0c |
|
MD5 | b7c210e1ebaa69ffdbfe5a3568d9d0b4 |
|
BLAKE2b-256 | eca628298547526a178014d4270050889ced03b625fa343cb7f341b3c76ca0b6 |
Close
Hashes for kgdata-5.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e382dfdee3393daa987a2088157f24f53746dd773abc568e2881a44dd9941fe4 |
|
MD5 | bc6c0da0f9e7925cdf86757b2d88f48f |
|
BLAKE2b-256 | ee4c4272b4f1cb18916eb567a93262e12265667c794773a4714acbd0a3247416 |
Close
Hashes for kgdata-5.3.0-cp38-cp38-macosx_10_14_x86_64.macosx_11_0_arm64.macosx_10_14_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c491956ed0fdcdd7855965d53fe09d5561fb571d6edd3f10e0b6ef9c43f5d3ee |
|
MD5 | 5c2451da097207d2cf9944bd720a20d3 |
|
BLAKE2b-256 | 9273215d86967c2925aff27f1d70800c2250334970a8e8acbc72f224c2891d52 |