End to End application for named entity recognition. Highlights: 1. Powerd by GenAi 2. Few shot Learning 3. Training and inference pipelines
Project description
auto_ner
End to End application for Custom Named Entity Recognition. Highlights:
- Powerd by GenAi
- Few shot Learning
- Training and inference pipelines
Auto_annotate
will take unlabeled text data and create labellied text data that can further be used for custom Named Entity Recognition (NER) Model training.
Installation
Pypi
run following command in terminal
pip install auto-ner
From source
Run following command in terminal
git clone https://github.com/bokey007/auto_ner.git
cd auto_ner
python setup.py sdist bdist_wheel
pip install ./dist/imp3-0.1.0.tar.gz
Usage
auto_ner.run
- Above command will lauch the app on default port 8501.
- Open the browser and go to http://localhost:8501
- Select the image and then select the appropriate set of operations you want to perform on that perticular image.
- play with the parameters interatively untill you reach at optimal configuration.
auto_ner.run --port 8080
Above command can be used to specify the port on which you want to run the app.
Application Workflow
System Architecture
Demo
Solution is implemnted in following three steps
- Create the baseline Spacy Model ([Transformer implementation on Hold])
- Meet the Expectations Training Bert ([ToDo])
- Exeed the expectations
- Few shot / Zero Shot NER
- Beyond mere NER : entyity linking ([ToDo])
Development tools:
- setuptools (https://pypi.org/project/setuptools/): Used to create a python package
- pipreqs (https://pypi.org/project/pipreqs/): Used to create requirements.txt file
- twine (https://pypi.org/project/twine/): Used to upload the package to pypi.org
- Github Actions (): Used to automate the process of uploading the package to pypi.org
- pytest (https://pypi.org/project/pytest/): Used to write unit tests
- wheel (https://pypi.org/project/wheel/): Used to create a wheel file
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
File details
Details for the file auto_ner-0.1.2-py3-none-any.whl
.
File metadata
- Download URL: auto_ner-0.1.2-py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 96d3ed6226012e5de02b860c2e8e570682459c740b75209c91e9bab0b1e3cee2 |
|
MD5 | 5b51a33caa731cf676dc4f45698c21b8 |
|
BLAKE2b-256 | 8335c9c4d0213e53220b0b0d05c790c95899126263e508ae3f68c769d5516286 |