qhub - automated data science environments on cloud environments
QHub is an open source project from Quansight that enables organizations to build and maintain cost-effective and scalable compute/data science platforms on-premise or on any cloud provider with minimal in-house experience. It is a focused JupyterHub distribution that integrates many open source libraries into a coherent platform. The components that form QHub can be rearranged and customized to support many different enterprise use cases. For more information see https://www.quansight.com/post/announcing-qhub.
Quansight LLC is a data science and analytics consulting firm specializing in open source software around the PyData community including Jupyter, scikit-learn, Dask, Pandas, PyTorch, NumPy, SciPy, and much more. Quansight was co-founded by Travis Oliphant, founder of Anaconda, NumFOCUS, and PyData and creator of SciPy, NumPy, and Numba. For more information see https://www.quansight.com/about-us.
Usage
qhub is installed as a command line application in Python. It requires you to choose your the cloud provider you desire. once you've decided on a provider qhub will walk you through the following steps to configure your deployment:
- initialize
- render
- deploy
these steps realized using the qhub CLI.
initialize configurations
qhub init do
qhub init aws
qhub init gcp
The qhub init command will generate configuration files for that service. The configutation files can be tailored to the needs of your organization. Each file specifies general project information, security, infrastructure settings, computational resource profiles and data science environments. See documentation on modifying your configuration file for all of the cloud providers: Configuration File
The configuration file is your user interface into deploying and scaling your data science environment. Each change triggers Github Action that will seamlessly update your infrastructure.
Check out the qhub documentation for more detailed information.
rendering the configuration file
we need more information here.
qhub render -c qhub-config.yaml -o ./ --force
what is this business?
qhub interfaces
The qhub api normalizes with the nuances of configuring interactive data science environments across multiple client providers. The python command line interfaces define an initial environment state that is modified, and its changes are propogated by continuous integration.
Each qhub cloud provider has different configuration specifications; more details can be found at the following links about the Digital Ocean, AWS, and GCP configurations.
Installing qhub
qhub is a pure python package that can be downloaded from the pypi.
pip install qhub
License
Developer
qhub is an open source project and welcomes issues and pull requests.
Contributing
Release
Creating a release:
- Increment the version number in
qhub/VERSION - Ensure that the version number in
qhub/VERSIONis used in pinning qhub in the github actionsqhub/template/{{ cookiecutter.repo_directory }}/.github/workflows/qhub-config.yaml
4 maintainers
Metadata
4 maintainers
Release files for qhub 0.1.20
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| qhub-0.1.20.tar.gz | 32.2 kB | Details |
Release files / qhub-0.1.20.tar.gz
| Download URL | qhub-0.1.20.tar.gz |
|---|---|
| Size | 32.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c7cd1a05657a5a9d714742db9f5f303fe9308fda40c77d826ea4c51d4e36ac52
|
|
BLAKE2b-256 checksum How to use checksums |
d646004a6507a0defaf1a5e9fde100cbd86966e1e8faffdbf8ba79d5a735b603
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.6.1 requests/2.25.0 setuptools/49.2.1 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.8.6
|
