ETK: Information Extraction Toolkit
ETK is a Python library for high precision information extraction from many document formats. It proivdes a flexible framework of composable extractors that enables you to combine a host of predefined extractors provided in ETK with custom extractors that you may need to develop for your application. It supports extraction from HTML pages, text documents, CSV and Excel files and JSON documents. ETK is open-source software, released under the MIT license.
Documentation
Read the documentation here
Features
- Extraction from HTML, text, CSV, Excel, JSON
- High-precision predefined extractors for common entities (dates, phones, email, cities, ...)
- Extraction of microdata, schema.org and RDFa markup
- Integration with spaCy for text processing
- Automatic identification and extraction of HTML tables containing data
- Automatic identification and extraction of time series
- Semi-automatic generation of Web wrappers
- Scalable execution and management of extraction pipelines
- Automatic provenance recording
Releases
Installation
| Operating system: | macOS / OS X, Linux, Windows |
| Python version: | Python 3.6+ |
Install using pip
pip install etk
OR
You can also install ETK Manually. Clone or fork this repository, open a terminal window and in the directory where you downloaded ETK type the following commands
python3 -m venv etk2_env
source etk2_env/bin/activate
pip install -e .
Load the spacy modules
python -m spacy download en_core_web_sm
python -m spacy download en_core_web_lg (optional)
Note: If the above commands fail with s SSL error, run this:
python -m spacy download en_core_web_sm-2.0.0 --direct
To deactivate this virtual environment
deactivate
Run Tests
python -m unittest discover
Run ETK CLI
ETK needs to be installed as python package.
python -m etk <command> [options]
For example:
python -m etk regex_extractor "a.*c" "abcd"
Docker
Build image
docker build -t etk:test .
Run container
docker run -it etk:dev /bin/bash
Mount local volume for test
docker run -it -v $(pwd):/app/etk etk:dev /bin/bash
2 maintainers
Metadata
2 maintainers
Release files for etk 2.2.8
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| etk-2.2.8.tar.gz | 150.9 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| etk-2.2.8-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 354.0 kB
Release files / etk-2.2.8.tar.gz
| Download URL | etk-2.2.8.tar.gz |
|---|---|
| Size | 150.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2bd9cb0ae08a5908dd016af9450ee848905ab9e859fb495581d203873588bab1
|
|
BLAKE2b-256 checksum How to use checksums |
96e15c49f2bba4132cb703b71a767a911b9a05765c6f52b0e2391ee341175ad1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.12
|
Release files / etk-2.2.8-py3-none-any.whl
| Download URL | etk-2.2.8-py3-none-any.whl |
|---|---|
| Size | 203.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
317dd4bd2e4edcbbcd4e63fb8d4a05e7e112cbb50381d12ecab5bad943c891ef
|
|
BLAKE2b-256 checksum How to use checksums |
2e58c4a5a30bbd710b3a44f6f266c86bebf71a8010041a72e05e5659cd458a97
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.7.12
|
Security for etk 2.2.8
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
