pyvserv 1.0.3

High power secure server with blockchain backend.

PyvServer

Fully encrypted TCP/IP server.

    PyvServ is an encrypting TCP/IP server written in Python. The encryption algorithm is AES. (Advanced Encryption Standard) The key exchange uses ECC. (Elliptic curve) The server can be fully administered from the protocol side.

How to use, what it is for:

Public Voting System Blockchain server.
Charity administration, trust maintenance. (Zakat)
Internal currency / resource maintenance.

Public Voting System Blockchain server.

The system maintains an encrypted chain of vote events. Every entry has (among others) the Voter ID, an Electronic ID, and the vote action (register / cast / un-cast / withdraw), and of course, the vote.

The voter ID is a number allocated by authorities, the Electronic ID is a number allocated on initial login / registration / transaction by the system. The Voter Block Chain, the associated IDs, and the vote is visible to the public, so every voter can verify his / her participation. The voter ID is visible, but the data behind it is known by the electorate only.

The blockchain may be replicated to independent hosts, so falsifying it would require breaching multiple services.

The blockchain visibility allows that every voter can verify their participation. This also allows all parties to verify the chain, and create independent counts.

The chain can be verified for legitimate and singular registration. This system crates accountability from both the voter's side and the electorate (authority's) side.

Charity administration, trust maintenance. (Zakat)

The blockchain will allow the donation's public visibility and the donation's usage. It can accommodate arbitrary information, for instance: disbursement target, fund source, funding entity ... etc. The system handles unique IDs transparently, which allows privileged information to be encoded as a unique ID. This unique ID than can be turned back to real information by the publisher of the Unique ID, preserving privacy.

Internal resource / currency maintenance

The blockchain will allow monitoring internal resource allocation / usage.

    PyvServ contains protocol level encryption, which can be switched on by instructing the server to use an encryption (session) key.

    PyvServ contains a key exchange protocol, so the new session keys can be transmitted securely. The key exchange is based on ECC.

PyvServ has utilities to generate encryption keys. At least one key needs to be generated before use. (now automatic) The server picks from a pool of keys, so communication data is always distinctive. Make sure you generate some new keys with the 'pyvgenkeys' utility before production deployment.

PyvServ has blockchain empowered back end. The new data is linked to the previous record. Utilities to verify the data are also provided. (dbaseadm and chainadm)

PyvServ has file upload / download capabilities with encrypted transport.

PyvServ has replication facilities via a client based 'I have You have' mechanism featuring encrypted transport. It is also capable of replication on a 'replicate when received' mechanism. The replicated records are marked with a replication count, so replication does not enter looping. By default, the replicated records are not replicated any further, assuming a flat structure of replication.

Installation:

pip install pyvserv

Dependencies:

Most linux systems already have all the dependencies by default. Some dependencies are added automatically on installation.

 pydbase, pyvpacker, pyvecc, pyvguicom

The firewall needs to be opened for incoming connections on port xxxx

For example (assuming port 6666):

sudo iptables -A INPUT -p tcp --dport 6666
sudo iptables -A INPUT -p tcp --sport 6666

Please note that this is not a recommendation, it is a port we used during development.

Start server

The python server can be added to the system servers with the Makefile targets 'make genservice' and 'make instservice' The scripts will generate the service file to run under current user's credentials, and install it onto the running system. (requires sudo)

Platform:

This project was developed on Ubuntu 22.x. Most linux distributions should work. It is ported to Windows MSYS2, with all major functions operating as expected.

On Fedora, the service files need to be re-written to accomodate the quirk that the Fedora systectl does not allow user executables. Install the 'pip pyvserv' as root, and adjust the service file accordingly. If you want to use pyvserv with particular data directory, use the -r option.

Quick map:

Server.     subdir: pyvserver       -- Server has most all the commands done
Client.     subdir: pyvclient       -- Exercise server commands / demo code
Test Suite. subdir: pyvclient/tests -- official pytest tests
Tool Suite. subdir: pyvtools        -- Key generation etc ...
GUI base    subdir: pyvgui          -- Monitoring / administering the server
Studies.    subdir: study           -- testing/learning subsystems (ignore it)

Quick start:

One can mimic global connectivity on a single machine. This would allow the study of the client / server interaction before live deployment. This chapter assumes installation from github, replicating directory structure on the local drive.

open terminal window
navigate to the server's pyvserver subdir
type: ./pyvserv.py

open another terminal window
navigate to the pyvclient subdir
type: ./pyvcli_hello.py

The following (and more) should be printed on the command line:

./pyvcli_hello.py
Server initial: ['OK', 'pyvserv 1.0 ready']
resp ['OK', 'Hello', '6ccdaaf1-a22d-4140-9608-8fb93a8845af', '11812']
Server quit response: ['OK', 'Bye', '11812']

Quick rundown of the above test:

1.) Server responds to connection with signin message
2.) Delivers OK status, hello message, server serial number, and a unique id
3.) Server signs off. Repeats unique id / session number.

This interaction is typical of all the commands.

The unique ID is the session's thread ID and it is not cryptographically secure; Mostly useful for identifying the session on the client side.

The best way to learn about the operation of the server is to look at the sample client examples in the client source tree. (Files named pyvcli_*)

The pip install

Scripts are provided for the server, and some test clients. The server can be started as

pyvserver

The -P option is for non Developer mode, enabling 2FA authentication. (two factor authentication)

The command line client can be started as:

pyvcli_cli

In the command line client most of the server functions can be exercised. See the pyvcli_* utils for more examples of driving the server.

Command line help

Usage: pyvserv.py [options]

Options:
        -n   --host                 -  Set server hostname / interface.
        -r   --dataroot  dataroot   -  Set data root for server.
        -P   --pmode                -  Production mode ON. (allow 2FA)
        -l   --loglevel             -  Log level (0 - 10) default = 1
        -m   --mem                  -  Show memory trace.
        -N   --norepl               -  No replication. (for testing)
        -d   --debug     debug      -  Debug level 0-10
        -p   --port      port       -  Listen on port
        -v   --verbose              -  Verbose
        -q   --quiet                -  Quiet
        -V   --version              -  Print Version
        -h   --help                 -  Show Help

Client command line help example:

While most command line clients have their own help screen, here as a typical client utility's help screen:

Usage: pyvcli_uman.py [options]

Options:    -d level  - Debug level 0-10
            -p        - Port to use (default: 6666)
            -l login  - Login Name; default: 'user'
            -s lpass  - Login Pass; default: '1234'
            -u user   - User Name; default: 'user'
            -a        - Add user. Must be unique.
            -r        - Remove user (one of add or remove needed.
            -u user   - User Name; default: 'user'
            -p pass   - User pssword; default: '1234' (!!! for tests only)
            -m        - Add admin instead of regular user
            -v        - Verbose
            -q        - Quiet
            -h        - Help

Testing:

All pytest cases pass. Note that the for the pytest client tests one needs to start the 'pyvserv.py' server. The server --port and --dataroot option can ba used to start the server in an alternate universe. Please make sure it does not interfere with production.

============================ test session starts ==============================
platform linux -- Python 3.10.12, pytest-7.4.3, pluggy-1.0.0
rootdir: /home/<homedir>/pgpygtk/pyvserv
collected 15 items

test_afirst.py .                                                         [  6%]
test_file.py ..                                                          [ 20%]
test_hello.py .                                                          [ 26%]
test_help.py .                                                           [ 33%]
test_id.py .                                                             [ 40%]
test_key.py .                                                            [ 46%]
test_login.py .                                                          [ 53%]
test_noadmn.py .                                                         [ 60%]
test_rget.py .                                                           [ 66%]
test_rput.py .                                                           [ 73%]
test_sess.py ..                                                          [ 86%]
test_user.py .                                                           [ 93%]
test_ver.py .                                                            [100%]

============================== 15 passed in 9.47s ==============================

Additional tests can be found in the tests/ directory. The pyvcli_* files may also serve as test cases.

More test coming soon ....

Screen shots:

Screen shot of the Monitoring tool:

This screen shot depicts the monitoring (control panel) application 'pyvcpanel'. The top left area contains a live view of the pyvserver syslog. The top right contains a live view of the replicator log.

The bottom area of the window contains a live view of the incoming data, as it is originally formatted, without the blockchain and hash details.

All views monitor the live files, on the default setup, without interfering with any of the operations.

Windows compatibility

Pyvserv now functions in the Windows MSYS2 subsystem. All the major functionalities are ported. The file locking mechanism works, and all the pytests pass. Naturally, logging and readline etc ... works with the usual windows caveat.

For the GUI functions install the PyGobject subsystem. Instructions can be found very easily for that. Below, a screenshot of the pyvserv control panel in MSYS2.

The project is functional in MSYS2, but for real deployment we recommend Linux.

History:

Recent history kept, for the full list of changes consult the github site.

1.0.0   Sun 03.Mar.2024    Beta ready
1.0.0   Mon 11.Mar.2024    PIP installation with utils
1.0.0   Wed 13.Mar.2024    rget rput and family (rget=BC record get)
1.0.0   Thu 14.Mar.2024    Started GUI tools
1.0.1   Fri 15.Mar.2024    Added LIC, verification, doc, tally
1.0.3   Wed 03.Apr.2024    Ported to MSYS2, throttle, for multiprocess

Statistics

Project name
    pyvserv
Report Period
    2018-12-31 20:50:04 to 2024-03-15 04:47:25
Age
    1901 days, 101 active days (5.31%)
Total Files
    287
Total Lines of Code
    70286 (235368 added, 165082 removed)
Total Commits
    216 (average 2.1 commits per active day, 0.1 per all days)
Authors
    6 (average 36.0 commits per author)

Security review:

  As of today, (Fri 15.Mar.2024) the 256 bit AES is considered unbreakable by available state of the art means. The key exchange algorithm ECC 384 bit is also considered safe. These algorithms are used dynamically, as a randomly picked key is used in every session. The session is also able to dynamically change keys mid flight, on command.

  The checksum verification and link verification both use SHA256 (256 bit) hashes. This is generated every time a transaction is created.

  The proof of work is a modest 3 generations deep. This can be calculated with an everyday desktop in one - to - three seconds. Even though this looks like a small amount, it adds up if one wants to re-generate (fake) a whole chain. Additionally, the check sum, the link sum, and proof of work interact, changing one will effect the other. This way a sum verification and link verification and the proof of work verification together create an ironclad safety solution.

Written by Peter Glen, 2022, 2023, 2024 Released under MIT License (MIT)

// EOF