INFO-EXTRACTION

NLP project to identify and categorize named entities in an input text.

Table of Content

• INFO-EXTRACTION
  • Table of Content
  • Setup Package
    • IMPORTANT STEP
    • List Available Commands
  • Build And Publish The Package
    • Using Setuptools
    • Using Poetry
  • Check HugingFace Cache
  • Run Tests

Setup Package

IMPORTANT STEP

• To setup the package locally, run:

make setup_venv

List Available Commands

• To list all the available commands, run:

make help

Build And Publish The Package

Using Setuptools

• Build the package by running:

# Install packages required for building and publishing
python -m pip install build twine

# Build
python setup.py clean --all
python setup.py sdist bdist_wheel

# Verify build
twine check dist/*

# Upload package
twine upload dist/* --verbose

Using Poetry

• Build the package using Poetry by running:

# Install packages required for building and publishing
pip install --no-cache poetry==1.4.2
poetry lock "--no-update" && poetry install --no-interaction

export PYPI_TOKEN="your_pypi_token"
poetry config pypi-token.pypi ${PYPI_TOKEN}

# Build and upload package
poetry publish --build

Check HugingFace Cache

• Check the locally cached models and dataset by running:

huggingface-cli scan-cache -v

Run Tests

• For unit tests, run:

# All tests
make run_test