quackamollie-core 0.1

Project description

Quackamollie is a Telegram chat bot developed in Python using the library aiogram to serve LLM models running locally using Ollama.

This package is the core of the Quackamollie project. It contains:

• a command line interface which automatically discover addons declared as entrypoints

• the main commands, filters and callbacks for interacting with Quackamollie through Telegram

• SQLAlchemy ORM connectors and models to interact with a PostgreSQL database for Quackamollie

• Alembic configuration to automatically migrate the PostgreSQL database

• a Docker Compose configuration file to run a PostgreSQL database

• meta-classes for models and model managers

• auto-discovery of models, model managers and CLI subcommands using entrypoints

To install Quackamollie easily with model managers and models, we kindly invite you to refer to the Quackamollie main project page which includes tutorials to deploy Quackamollie using Docker Compose.

This documentation mainly contains details destined to developers of the Quackamollie project. These information can also be useful for developers who want to run Quackamollie locally without using Docker.

Requirements

Virtual environment

• Setup a virtual environment in python 3.10

make venv
# or
python3 -m venv venv

• Activate the environment

source venv/bin/activate

• If you want to deactivate the environment

deactivate

Tests

make devtools
# or
pip install tox

tox

tox -e lint

Documentation

• To auto-generate the documentation configuration

tox -e gendocs

• To generate the documentation in Html

tox -e docs

• An automatically generated version of this project documentation can be found here

  • N.B.: This automatically generated documentation of the Quackamollie core project is still laking a lot of things. Sorry for the inconvenience.

Install

• Install the application from sources

make install
# or
pip install .

• Or install it from distribution

pip install dist/quackamollie-core-0.1.tar.gz

• Or install it from wheel

pip install dist/quackamollie-core-0.1.whl

• Or install it from PyPi repository

pip install quackamollie-core  # latest
# or
pip install "quackamollie-core==0.1"

Docker

• To build the application docker

docker build --network=host -t quackamollie_core:0.1 .

• The official Docker image of this project is available at: registry.gitlab.com/forge_of_absurd_ducks/quackamollie/lib/quackamollie_core

• You can pull the image of the current release:

docker pull registry.gitlab.com/forge_of_absurd_ducks/quackamollie/lib/quackamollie_core:latest  # or dev
# or
docker pull registry.gitlab.com/forge_of_absurd_ducks/quackamollie/lib/quackamollie_core:0.1

Docker-compose

• To run database using docker-compose, you must first set environment variables:

  • QUACKAMOLLIE_DB_HOST: typically 0.0.0.0

  • QUACKAMOLLIE_DB_PORT: typically 5432

  • QUACKAMOLLIE_DB_NAME: typically quackamollie

  • QUACKAMOLLIE_DB_USERNAME: typically quackamollie

  • QUACKAMOLLIE_DB_PASSWORD: choose a strong admin password

• Then you can run:

docker compose up
# or to detach
docker compose up -d

# if you need to run it with sudo don't forget to add the -E option to pass the environment variables you've set
sudo -E docker compose up

Database migration

• Quackamollie provides a wrapper for the alembic command which initializes the database info the same way they are initialized at runtime. You can call alembic by using instead quackamollie db alembic. For example:

quackamollie db alembic --help

• We recommend you to use a configuration file using one of the examples provided in config/examples/ and to change variables to match the ones used when calling docker compose up.

• To create schema revision if the database changes:

quackamollie -c config/config.yml db alembic revision --autogenerate -m "A new change."

• You can then inspect the migration code (in python) with:

cat migrations/versions/*

• Also inspect the resultant SQL code with:

quackamollie -c config/config.yml db alembic upgrade --sql +1

• Finally, you can apply the migration with:

quackamollie -c config/config.yml db alembic upgrade +1  # If you want to jump from 1
quackamollie -c config/config.yml db alembic upgrade head  # If you want to go all the way to head

• If you now connect to pgcli, you can test that the new table exists:

make dbtools
pgcli -U ${QUACKAMOLLIE_DB_USERNAME} -h ${QUACKAMOLLIE_DB_HOST} -p ${QUACKAMOLLIE_DB_PORT} ${QUACKAMOLLIE_DB_NAME}
# and then on the pgcli console:
\dt
# and again on the pgcli console:
SELECT * FROM users;

• alembic downgrade -1

quackamollie -c config/config.yml db alembic downgrade -1

• You can also migrate using the docker image from our official docker registry.

docker run --rm --name quackamollie-migration \
--network host \
--mount type=bind,source="$(pwd)"/config/config.yml,target=/config/config.yml,readonly \
registry.gitlab.com/forge_of_absurd_ducks/quackamollie/lib/quackamollie_core:0.1 \
-vvvv -c /config/config.yml db alembic upgrade head

# if you need to run it with sudo don't forget to add the -E option to pass the environment variables you've set
sudo -E docker run --rm --name quackamollie-migration \
--network host \
--mount type=bind,source="$(pwd)"/config/config.yml,target=/config/config.yml,readonly \
registry.gitlab.com/forge_of_absurd_ducks/quackamollie/lib/quackamollie_core:0.1 \
-vvvv -c /config/config.yml db alembic upgrade head

• To do the same using docker-compose, please refer to the quackamollie main repository.

Running the project

Quackamollie-core provides a command tool line named quackamollie. You can find examples of configuration files in the folder config/examples.

quackamollie -vvvv -c config/config.yml serve

Pictures and demonstration videos will be included in the documentation in future releases.

Database

• This is the latest schema of the database, generated automatically by the plugin quackamollie-devtools (can be installed using pip install quackamollie-devtools):

Authors

• QuacktorAI - Initial work - quacktorai

Contributing

Currently, the project is still in early stages. It lacks several base features we expect to implement in the versions 0.2 and 0.3, for example RAG capabilities will be added in version 0.2.

For this reason, we do NOT accept yet issues asking for new features. However, you can report bugs or assimilated problems you may encounter and we will do our best to fix them.

If you want to report a bug of quackamollie-core, please open an issue in the Gitlab ticket management section of this project

For more details on the general contributing mindset of this project, please refer to CONTRIBUTING.md.

Credits

Section in writing, sorry for the inconvenience.