productml 0.0.4

Product-ml

A package built by DevsDoData for product-level inference.

Includes functionality for ML lifecycle including data preparation and model training.

Used to sync key workflows across platforms locally, cloud (Colab) notebooks and deployment.

Setup Venv

Google Colab uses Python version 3.7.13 and we need to match that. Otherwise it would cause issues.

sudo apt update && sudo apt install python3.7
sudo apt install python3.7-distutils
pipenv install --python="/usr/bin/python3.7"

And then install everything with

python3 -m pipenv install \
    loguru wandb hydra-core \
    fuzzywuzzy \
    torchvision \
    opencv-python scikit-learn numpy matplotlib \
    pytest \
    twine

Distributing the package

Specify the dependencies and build the package

pipenv requirements | sed 1d > requirements.txt

python3 ./productml/setup.py install sdist bdist_wheel

Then create a new dir for testing.

cd ../ && mkdir test-dir && cd test-dir

touch activate.sh < echo ". ./venv/bin/activate"

pip3 install virtualenv && virtualenv venv

source activate.sh

touch test.py && test.py < echo "from productml.data.labelling import text_matching"

python3 test.py

And you should not get an ImportError or any other error for that matter.