Skip to main content

Vantage6 algorithm store

Project description


vantage6

A Privacy Enhancing Technology (PET) Operations platform

Release PyPI vantage6 Unittests Coverage Status Codacy Badge DOI Discord Research software directory

QuickstartProject structureJoin the communityLicenseCode of conductReferences


This repository is contains all the vantage6 infrastructure source code. The vantage6 technology enables to manage and deploy privacy enhancing technologies like Federated Learning (FL) and Multi-Party Computation (MPC). Please visit our website to learn more!

You can find more (user) documentation at readthedocs. If you have any questions, suggestions or just want to chat about federated learning: join our Discord) channel.

Infrastructure overview

Vantage6 architecture overview

A High level overview of the vantage6 infrastructure. Vantage6 has both a client-server and peer-to-peer architecture. The client is used by the researcher to create (PET) computation requests. It is also used to manage users, organizations and collaborations. The server contains users, organizations, collaborations, tasks and their results. It provides a central access point for both the clients and nodes. The nodes have access to privacy sensitive data and handle computation requests retrieved from the server. Computation request are executed as separate containers on the node. These containers are connected to containers at other nodes by a VPN network.

:books: Quickstart

Requirements

The vantage6 infrastructure is delivered in Docker images. To run these images, you need to have Docker installed. To install the latest version of the vantage6 CLI, you need to have Python, we recommend using an environment manager like mini-conda.

Install the latest version of the vantage6 CLI by using:

pip install vantage6

This install the v6 commands, which allows you to manage your nodes and servers. To view all available options, run:

v6 --help

For example you can create a local test setup by using:

v6 dev create-demo-network

This creates a local network with a server and two nodes. You can start the network by running:

v6 dev start-demo-network

This will start the server and nodes in the background. You can view the logs by running:

# View node logs
v6 node attach

# View server logs
v6 server attach

From here you can use the vantage6-client to interact with the server. The demo network has a pre-configured organization with the following credentials:

  • Username: dev_admin
  • Password: password

For example, you can create a new organization by running:

from vantage6.client import Client

client = Client('http://127.0.0.1', 7601, '/api', log_level='debug')
client.authenticate('dev_admin', 'password')
client.setup_encryption(None)

client.organization.create(
    name='My organization',
    address1='My address',
    address2='My address',
    zipcode='1234AB',
    country='The Netherlands',
    domain='my-organization.com'
)

You can find more (user) documentation at readthedocs

Project structure

PYPI packages

This repository is home to 6 PyPi packages:

Note that when using vantage6 you do not install the server and node packages. These are delivered to you in Docker images.

This repository also hosts the code for the vantage6 user interface (UI). The UI is an Angular web application that can be used to interact with the vantage6 server easily.

Docker images

The vantage6 infrastructure is delivered in Docker images. All Docker images are stored in the vantage6 GitHub Container Registry. The most important images are:

  • ghcr.io/vantage6/node:VERSION -> Node application Docker image
  • ghcr.io/vantage6/server:VERSION -> Server application Docker image
  • ghcr.io/vantage6/ui:VERSION -> User interface Docker image
  • ghcr.io/vantage6/algorithm-store:VERSION -> Algorithm store Docker image

with VERSION being the full semantic version of the vantage6 infrastructure, e.g. 4.0.0 or 4.1.0rc0.

Several other images are used to support the infrastructure:

  • ghcr.io/vantage6/infrastructure-base:VERSION -> Base image for the infrastructure
  • ghcr.io/vantage6/squid:VERSION -> Squid proxy image used for the whitelisting service
  • ghcr.io/vantage6/alpine -> Alpine image used for vpn traffic forwarding
  • ghcr.io/vantage6/vpn-client -> VPN image used to connect to the VPN
  • ghcr.io/vantage6/vpn-configurator -> VPN image used for initialization
  • ghcr.io/vantage6/ssh-tunnel -> SSH tunnel image used for connecting algorithms to external services

And finally there are some images released for algorithm development:

  • ghcr.io/vantage6/algorithm-base:MAJOR.MINOR -> Base image for algorithm development
  • ghcr.io/vantage6/algorithm-ohdsi-base:MAJOR.MINOR -> Extended algorithm base image for OHDSI algorithm development

:gift_heart: Join the community!

We hope to continue developing, improving, and supporting vantage6 with the help of the federated learning community. If you are interested in contributing, first of all, thank you! Second, please take a look at our contributing guidelines and our code of conduct.

:scroll: License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

:black_nib: Code of Conduct

Please note that this project is released with a Contributor Code of Conduct. By participating in any way in this project you agree to abide by its terms.

:black_nib: References

If you are using vantage6, please cite this repository as well as the accompanying papers as follows:

  • F. Martin, M. Sieswerda, H. Alradhi, et al. vantage6. Available at https://doi.org/10.5281/zenodo.7221216. Accessed on MONTH, 20XX.
  • A. Moncada-Torres, F. Martin, M. Sieswerda, J. van Soest, G. Gelijnse. VANTAGE6: an open source priVAcy preserviNg federaTed leArninG infrastructurE for Secure Insight eXchange. AMIA Annual Symposium Proceedings, 2020, p. 870-877. [BibTeX, PDF]
  • D. Smits*, B. van Beusekom*, F. Martin, L. Veen, G. Geleijnse, A. Moncada-Torres, An Improved Infrastructure for Privacy-Preserving Analysis of Patient Data, Proceedings of the International Conference of Informatics, Management, and Technology in Healthcare (ICIMTH), vol. 25, 2022, p. 144-147. [BibTeX, PDF]

vantage6.aiDiscordDiscourseUser documentation

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vantage6_algorithm_store-4.15.0rc1.tar.gz (74.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vantage6_algorithm_store-4.15.0rc1-py3-none-any.whl (96.2 kB view details)

Uploaded Python 3

File details

Details for the file vantage6_algorithm_store-4.15.0rc1.tar.gz.

File metadata

File hashes

Hashes for vantage6_algorithm_store-4.15.0rc1.tar.gz
Algorithm Hash digest
SHA256 fe943d50c5eb537b5be35576c82ce8d673048ac5bf024fb6f651aa02dc9f5554
MD5 ff98382d19cecfe62bf80452ceaf24e0
BLAKE2b-256 b7fa11f51ef4336c3b3c2470a34c92750ed150a93744df2f6110c5abfe8a83e1

See more details on using hashes here.

File details

Details for the file vantage6_algorithm_store-4.15.0rc1-py3-none-any.whl.

File metadata

File hashes

Hashes for vantage6_algorithm_store-4.15.0rc1-py3-none-any.whl
Algorithm Hash digest
SHA256 c375f8d89f87a3b7acac284c2a480a76d8292bb2a95d91d4f3313887ae9d152e
MD5 3c98bd5d9977e24ecccf7cdc4011da1a
BLAKE2b-256 b4a094454c63e45c538612a0c95851dce5c7e8b01b571e28e7e20c615eaa9f32

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page