Cloudwise
cloudwise is Surreal’s cloud infrastructure provisioner based on Terraform. Surreal’s website and github.
It prepares a kubernetes cluster using terraform. It generates .tf.json files that are also recognized by Symphony.
Installation
Usage
(Optional, Recommended) Create and work in a clean directory as running terraform would generate relevant files.
> mkdir surreal
> cd surreal
Google Cloud
You first need to setup credentials for terraform to access google cloud. See guide here. Choose one of the two methods:
Run the following command
gcloud auth application-default loginor
Go to the api key management page https://console.cloud.google.com/apis/credentials/serviceaccountkey and select Create new service account. You would need to give the service account sufficient permissions to do things properly. Project editor would suffice but is also more than enough. You can then generate and download the key, (json format is fine). Put the path to the .json file into the commandline argument when prompted.
Follow the instructions in the commandline tool.
> cloudwise-gke
It will provide instructions and generate a <cluster_name>.tf.json file which terraform recognizes. If you have generated a .json credential file, you should provide it when prompted. * terraform init && terraform plan describes changes to be made. * terraform apply makes the changes to your cloud project. * After cluster creation, obtain credentials for kubectl.
> gcloud container clusters get-credentials <cluster_name>
If you have GPUs in your cluster, create the daemon set to install drivers, see documentation.
> kubectl apply -f https://raw.githubusercontent.com/GoogleCloudPlatform/container-engine-accelerators/stable/nvidia-driver-installer/cos/daemonset-preloaded.yaml
The generated <cluster_name>.tf.json is also recognized by Symphony’s scheduling mechanism and Surreal. So you may want to link to it
If you want to remove everything, run terraform destroy
AWS
Stay tuned
Azure
Stay tuned
FAQs:
Terraform install fails.
If you are seeing error: ... API has not been used in project...: during terraform apply, go to the Kubernetes Engine tab and/or Compute Engine tab on your google cloud console to enable their APIs.
GPU nodes are not scaling up.
Check if the driver installation daemon set is running (see documentation).
Metadata
Release files for cloudwise 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| cloudwise-0.1.1.tar.gz | 9.1 kB | Without provenance | Details for cloudwise-0.1.1.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| cloudwise-0.1.1-py3-none-any.whl | Python 3 | none | any | Details for cloudwise-0.1.1-py3-none-any.whl |
Total release size: 18.1 kB
Release files / cloudwise-0.1.1.tar.gz
| Download URL | cloudwise-0.1.1.tar.gz |
|---|---|
| Size | 9.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0cf1758321d4191caed367369c01976e15e98259d890b69fbed0f95052529f3d
|
|
BLAKE2b-256 checksum How to use checksums |
30d3734b2449ae6b66c7f91bb5ffd2af344b8ef016a36e58b6cf211ea3dbdcb6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.20.0 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.5
|
Release files / cloudwise-0.1.1-py3-none-any.whl
| Download URL | cloudwise-0.1.1-py3-none-any.whl |
|---|---|
| Size | 9.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b19b5d29f42f8d91a45bc2fbba3185e6e7b699b919a165a1d9f7ebd35aeaa8de
|
|
BLAKE2b-256 checksum How to use checksums |
ed85ee86a4dd11894820b9be5983625e09e10d5fc79cb4b873b098b0725ce6ed
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.12.1 pkginfo/1.4.2 requests/2.20.0 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.5
|
Security for cloudwise 0.1.1
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.