End to End application for named entity recognition. Highlights: 1. Powerd by GenAi 2. Few shot Learning 3. Training and inference pipelines
Project description
auto_ner
End to End application for Custom Named Entity Recognition. Highlights:
- Powerd by GenAi
- Few shot Learning
- Training and inference pipelines
Auto_annotatewill take unlabeled text data and create labellied text data that can further be used for custom Named Entity Recognition (NER) Model training.
Installation
Pypi
run following command in terminal
pip install auto-ner
From source
Run following command in terminal
git clone https://github.com/bokey007/auto_ner.gitcd auto_nerpython setup.py sdist bdist_wheelpip install ./dist/imp3-0.1.0.tar.gz
Usage
auto_ner.run
- Above command will lauch the app on default port 8501.
- Open the browser and go to http://localhost:8501
- Select the image and then select the appropriate set of operations you want to perform on that perticular image.
- play with the parameters interatively untill you reach at optimal configuration.
auto_ner.run --port 8080
Above command can be used to specify the port on which you want to run the app.
Application Workflow
System Architecture
Demo
Solution is implemnted in following three steps
- Create the baseline Spacy Model ([Transformer implementation on Hold])
- Meet the Expectations Training Bert ([ToDo])
- Exeed the expectations
- Few shot / Zero Shot NER
- Beyond mere NER : entyity linking ([ToDo])
Development tools:
- setuptools (https://pypi.org/project/setuptools/): Used to create a python package
- pipreqs (https://pypi.org/project/pipreqs/): Used to create requirements.txt file
- twine (https://pypi.org/project/twine/): Used to upload the package to pypi.org
- Github Actions (): Used to automate the process of uploading the package to pypi.org
- pytest (https://pypi.org/project/pytest/): Used to write unit tests
- wheel (https://pypi.org/project/wheel/): Used to create a wheel file
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file auto_ner-0.1.2-py3-none-any.whl.
File metadata
- Download URL: auto_ner-0.1.2-py3-none-any.whl
- Upload date:
- Size: 8.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
96d3ed6226012e5de02b860c2e8e570682459c740b75209c91e9bab0b1e3cee2
|
|
| MD5 |
5b51a33caa731cf676dc4f45698c21b8
|
|
| BLAKE2b-256 |
8335c9c4d0213e53220b0b0d05c790c95899126263e508ae3f68c769d5516286
|