Skip to main content

End to End application for named entity recognition. Highlights: 1. Powerd by GenAi 2. Few shot Learning 3. Training and inference pipelines

Project description

auto_ner

End to End application for Custom Named Entity Recognition. Highlights:

  1. Powerd by GenAi
  2. Few shot Learning
  3. Training and inference pipelines
  4. Auto_annotate will take unlabeled text data and create labellied text data that can further be used for custom Named Entity Recognition (NER) Model training.

Installation

Pypi

run following command in terminal

pip install auto-ner

From source

Run following command in terminal

  1. git clone https://github.com/bokey007/auto_ner.git
  2. cd auto_ner
  3. python setup.py sdist bdist_wheel
  4. pip install ./dist/imp3-0.1.0.tar.gz

Usage

auto_ner.run
  • Above command will lauch the app on default port 8501.
  • Open the browser and go to http://localhost:8501
  • Select the image and then select the appropriate set of operations you want to perform on that perticular image.
  • play with the parameters interatively untill you reach at optimal configuration.
auto_ner.run --port 8080

Above command can be used to specify the port on which you want to run the app.

Application Workflow

System Architecture

Demo

Solution is implemnted in following three steps

  1. Create the baseline Spacy Model ([Transformer implementation on Hold])
  2. Meet the Expectations Training Bert ([ToDo])
  3. Exeed the expectations
    • Few shot / Zero Shot NER
    • Beyond mere NER : entyity linking ([ToDo])

Development tools:

  1. setuptools (https://pypi.org/project/setuptools/): Used to create a python package
  2. pipreqs (https://pypi.org/project/pipreqs/): Used to create requirements.txt file
  3. twine (https://pypi.org/project/twine/): Used to upload the package to pypi.org
  4. Github Actions (): Used to automate the process of uploading the package to pypi.org
  5. pytest (https://pypi.org/project/pytest/): Used to write unit tests
  6. wheel (https://pypi.org/project/wheel/): Used to create a wheel file

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

auto_ner-0.1.2-py3-none-any.whl (8.5 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page