Skip to main content

End to End application for named entity recognition. Highlights: 1. Powerd by GenAi 2. Few shot Learning 3. Training and inference pipelines

Project description

auto_ner

End to End application for Custom Named Entity Recognition. Highlights:

  1. Powerd by GenAi
  2. Few shot Learning
  3. Training and inference pipelines
  4. Auto_annotate will take unlabeled text data and create labellied text data that can further be used for custom Named Entity Recognition (NER) Model training.

Installation

Pypi

run following command in terminal

pip install auto-ner

From source

Run following command in terminal

  1. git clone https://github.com/bokey007/auto_ner.git
  2. cd auto_ner
  3. python setup.py sdist bdist_wheel
  4. pip install ./dist/imp3-0.1.0.tar.gz

Usage

auto_ner.run
  • Above command will lauch the app on default port 8501.
  • Open the browser and go to http://localhost:8501
  • Select the image and then select the appropriate set of operations you want to perform on that perticular image.
  • play with the parameters interatively untill you reach at optimal configuration.
auto_ner.run --port 8080

Above command can be used to specify the port on which you want to run the app.

Application Workflow

System Architecture

Demo

Solution is implemnted in following three steps

  1. Create the baseline Spacy Model ([Transformer implementation on Hold])
  2. Meet the Expectations Training Bert ([ToDo])
  3. Exeed the expectations
    • Few shot / Zero Shot NER
    • Beyond mere NER : entyity linking ([ToDo])

Development tools:

  1. setuptools (https://pypi.org/project/setuptools/): Used to create a python package
  2. pipreqs (https://pypi.org/project/pipreqs/): Used to create requirements.txt file
  3. twine (https://pypi.org/project/twine/): Used to upload the package to pypi.org
  4. Github Actions (): Used to automate the process of uploading the package to pypi.org
  5. pytest (https://pypi.org/project/pytest/): Used to write unit tests
  6. wheel (https://pypi.org/project/wheel/): Used to create a wheel file

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

auto_ner-0.1.2-py3-none-any.whl (8.5 kB view details)

Uploaded Python 3

File details

Details for the file auto_ner-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: auto_ner-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 8.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.10

File hashes

Hashes for auto_ner-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 96d3ed6226012e5de02b860c2e8e570682459c740b75209c91e9bab0b1e3cee2
MD5 5b51a33caa731cf676dc4f45698c21b8
BLAKE2b-256 8335c9c4d0213e53220b0b0d05c790c95899126263e508ae3f68c769d5516286

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page