Knowledge Data Analysis and Processing Platform
This library contains a collection of utilities for efficiently processing and anlyzing the data of Wiki-based and QnA-based portals (eg., Wikipedia, Wikia, Stack Exchange, etc.). The function takes Knol-ML files as input. Most of the functions of this library are implemented in such a way that parallel processing can be achieved.
The library is currently in the development phase, feel free to raise an issue. We welcome the community to contribute towards KDAP code base and ARK dataset. Please check our webpage for more details GitHub Page
Table of contents
REQUIREMENTS
- Python3
- requests==2.21.0
- internetarchive==1.8.5
- numpy
- wikipedia
- psutil>=5.6.6
- mwparserfromhell==0.5.4
- nltk==3.4.5
- matplotlib
- bx-python
- pyunpack
- mwviews
The list of dependencies is shown in ./requirements.txt, however the installer takes care of installing them for you.
INSTALL
Installing kdap is easily done using pip. Assuming it is installed, just run the following from the command-line:
pip install kdap
This will also install the necessary dependencies.
SOURCE CODE
If you like to clone from source, you can do it with very simple steps. First, clone the repo:
> git clone https://github.com/descentis/kdap.git
> cd kdap
TUTORIAL
For information on how to use KDAP, refer to the official documentation:
- http://kdap.readthedocs.io
- Soon we will provide a video Tutorial, till then please watch our teaser on Youtube: https://youtu.be/-3boFWHB5oM
How to contribute
Fork the project and follow the instructions on how to get started with source code. I will be updating the test cases on which you can test your code. Stay tuned.
License
This software is licensed under the BSD 3-Clause License.
This project has received funding from the CSRI, Department of Science and Technology India via grant no. SR/CSRI/344/2016
Authors
- Amit Arjun Verma - Author - descentis
- S.R.S Iyengar - Author - sudarshansudarshan
- Aayush Sabharwal - Contributor - AayushSabharwal
Knol-ML data dump
The data dump can be found here
1 maintainer
Metadata
1 maintainer
Release files for kdap 0.1.29
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| kdap-0.1.29.tar.gz | 48.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| kdap-0.1.29-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 100.6 kB
Release files / kdap-0.1.29.tar.gz
| Download URL | kdap-0.1.29.tar.gz |
|---|---|
| Size | 48.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2ceec0338e053f400e1e603bdfa96e0cc55ddaa5621229b588d34d9d5f626fa6
|
|
BLAKE2b-256 checksum How to use checksums |
76e2f45d2480430a5b5417090950152da5e32566377eeb63a3d04029c8b12c1c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/49.6.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.5
|
Release files / kdap-0.1.29-py3-none-any.whl
| Download URL | kdap-0.1.29-py3-none-any.whl |
|---|---|
| Size | 52.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b0b9401d68ee010248a727a0f19fcb1d2f0113aa5d134ea8838ae700a49cc981
|
|
BLAKE2b-256 checksum How to use checksums |
474f5ea3d5c50cb24d32152ac1d234bedbcaf98894255764404f7c4fd70a559b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.4.2 requests/2.21.0 setuptools/49.6.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.6.5
|
