ccdefundamentals 0.1.6

Shared code for CCDExplorer.io and its Notification Bot.

CCD Explorer Fundamentals

This repository hosts the shared code used by many of the other repositories in the CCD Explorer Universe. The only way I knew how to make this work (locally and in Docker containers), is by publishing this repo as a Python package.

Most important modules in the repo are:

• GRPCClient: this is the partial Python SDK that contains all relevant GRPC types and methods to request information from the GRPC endpoint from a node.
• MongoDB: this module contains the connection to the MongoDB instance (or replicaset).
• Tooter: this module is a light wrapper around Apprise, used to send notifications.
• CIS: this module contains logic to decode CIS-2 events according to the CIS-2 Specifications. This module is used in token accounting.

Modules

GRPCClient

This module is implemented as a partial Python SDK for the GRPC endpoint for a node. As such, it needs to be updated regularly whenever new types and methods are added to the GRPC Protocol Documentation. It relies heavily on BetterProto, however only version 2.0.0b6 seems to work. Hence, run

pip install "betterproto[compiler]"==2.0.0b6

to install this version.

BetterProto takes the .proto files from the Concordium GRPC Api Repo and converts this into the neccesary classes. When an update is performed on the Concordium GRPC Api Repo, copy the new files to the same location and run the following command:

python -m grpc_tools.protoc -I. --python_out=. --pyi_out=. --grpc_python_out=. --python_betterproto_out=. service.proto

This will generate the new _pb2.py(i) files.

CCD_Types

When I started with this project, I didn't know the first thing about Protobuf. To be honest, I still don't, but I have found a way to manage this by creating my own classes, mirroring the classes as generated by the types.proto file . These classes are stored in a submodule called CCD_Types. This contains 165 classes and 55 type aliases.

Queries

The services in the service.proto file are mirrored in the queries submodule, where all relevant GRPC calls are built. These are the methods that other services call to retrieve specific information from the node.

For every call to the node, it calls grpc.channel_ready_future to check if the service is ready (the node is able to respond to queries). Is this somehow fails, the module tries to connect to a different node (as supplied in the ENV variables).

Getting Started

Almost none of the modules in this repo as useful as a standalone package, with the exception of the GRPC SDK.

ENV variables

NOTIFIER_API_TOKEN (API token for notifier bot)
API_TOKEN (API token for actual bot)
FASTMAIL_TOKEN (I use Fastmail to send email, leave blank, won't send email)
MONGO_URI (MongoDB URI)
ADMIN_CHAT_ID (Telegram admin chat ID)
MAILTO_LINK (I use Fastmail to send email, leave blank, won't send email)
MAILTO_USER (I use Fastmail to send email, leave blank, won't send email)
GRPC_MAINNET (A list of dicts with GPRC hosts) (Example: [{"host": "localhost", "port": 20000}, {"host": "my.validator.com", "port": 20000}])
GRPC_TESTNET (Same as GPRC_MAINNET)

Tests

The CIS module and GRPC module have associated tests.

Authors

• explorer.ccd - Everything

License

This project is licensed under the Apache 2.0 License - see the LICENSE.md file for details.