QHub

Automated data science platform. From JupyterHub to Cloud environments with Dask Gateway.

QHub is an open source tool that enables users to build and maintain cost-effective and scalable compute/data science platforms on hpc or on kubernetes with minimal DevOps experience.

Not sure what to choose? Check out our FAQ.

This repository details the QHub version.

QHub HPC

Version of QHub based on OpenHPC.

NOTE: The tool is currently under development. Curious? Check out the Qhub HPC repository.

QHub

The Kubernetes version of QHub is built using Terraform, Helm, and GitHub Actions. Terraform handles the build, change, and versioning of the infrastructure. Helm helps to define, install, and manage Kubernetes. GitHub Actions is used to automatically create commits when the configuration file (qhub-config.yaml) is rendered, as well as to kick of the deployment action.

QHub aims to abstract all these complexities for our users. Hence, it is not necessary to know any of the above mentioned technologies to have your project successfully deployed.

TLDR: If you know GitHub and feel comfortable generating and using API keys, you should have all it takes to deploy and maintain your system without the need for a dedicated DevOps team. No Kubernetes, no Terraform, no Helm.

Cloud Providers

QHub offers out-of-the-box support for Digital Ocean, Amazon AWS and GCP. Support for Microsoft Azure will be added soon.

High-level illustration of QHub architecture

For more details, check out the release blog post.

Installation

Pre-requisites

QHub is supported by macOS and Linux operating systems (Windows is NOT currently supported).
Compatible with Python 3.6+. New to Python? We recommend using Anaconda.
Adoption of virtual environments (conda, pipenv or venv) is also encouraged.

Install

To install QHub run:

conda:
```
conda install -c conda-forge qhub
```
or pip:
```
pip install qhub
```

Once finished, you can check QHub's version (and additional CLI args) by typing:

qhub --help

If successful, the CLI output will be similar to the following:

usage: qhub [-h] [-v] {deploy,destroy,render,init,validate} ...

QHub command line

positional arguments:
  {deploy,destroy,render,init,validate}
                        QHub - 0.3.3

optional arguments:
  -h, --help            show this help message and exit
  -v, --version         QHub version

Usage

QHub requires the setting of environment variables to automate the deployments fully. For details on how to obtain those variables, check the Step-by-Step guide in the docs.

Once all the necessary credentials are gathered and set as UNIX environment variables, QHub can be deployed in under 20 minutes using:

qhub init   ... # generates initial config file and optionally automates deployment steps
qhub deploy ... # creates and configures the cloud infrastructure

Questions?

Have a look at our FAQ to see if your query has been answered.

We separate the queries for QHub into:

GitHub Discussions used to raise discussions about a subject, such as: "What is the recommended way to do X with QHub?"
Issues for queries, bug reporting, feature requests, documentation, etc.

We work around the clock to make QHub more excellent. Which implies that sometimes your query might take a while to get a reply. We apologise in advance and ask you to please, be patient.

Code of Conduct

To guarantee a welcoming and friendly community, we require contributors to follow our Code of Conduct.

Developer

To install the latest developer version (unstable) use:

pip install git+https://github.com/Quansight/qhub.git@dev

Contributions

Thinking about contributing? Check out our Contribution Guidelines.

License

QHub is BSD3 licensed.

Metadata

Release files for qhub 0.3.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for qhub 0.3.3
File	Size	Uploaded
qhub-0.3.3.tar.gz	39.9 kB	Apr 27, 2021	Details

Release files / qhub-0.3.3.tar.gz

Download URL	qhub-0.3.3.tar.gz
Size	39.9 kB
Tags	Source
SHA-256 checksum How to use checksums	`f6d55c2807aff2afdf40e81d8608dfacccd589fc95c69bfa82700a9a1981eb71`
BLAKE2b-256 checksum How to use checksums	`f401b672282ef8d7e99f757ad1a0148d5dbb4dbfcf0a7ad8f1fcba6909963134`
Upload date	Apr 27, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.9`