A cloud instance suggestor
Project description
Instance-Suggestor
Python module to help you pick the cheapest and the best performant instance any where across the globe on any cloud provider
Introduction
Data Science training is a computationally expensive job. With each computataionally expensive job, comes exponential costs. This repo is for Data Scientists to understand in real time to understand the best instance at any point in time which fits the exact need for the dataset and training job they have across any cloud provider
V0 (suggest.py)
Python Module which takes
- Source data
- Instance Name
- Cloud Provider
- Region
and outputs
- Alternate Instances across different cloud providers same region
- Alternate cheapest instance on the same provider same region
- Alternate cheapest instance on the same provider any region
- Cheapest Instance across any cloud provider same region
- Cheapest Instance across any cloud provider any region
Default arguments
- Instance Name : p3.16xlarge
- Provider : AWS
- Region : Price_US_East1
V1 (instance-suggestor.py)
Python Module which takes
- Source data
- Framework (MXNet, Tensorflow, PyTorch)
- Network
- Dataset
and outputs
- Similar instances across different cards
- Fastest instance on all cards
- Cheapest instance on all cards
Default arguments
- Framework : Tensorflow
- Network : ResNet-50 v1.5
- Dataset : ImageNet2012
How To Use
Requires basic Python packages like numpy, pandas preinstalled
Using as a Python Package
You can also do a pip install of the latest version of InstanceSuggestor
$ pip install InstanceSuggestor
$ python3 #open a python shell
> import InstanceSuggestor as inst
> inst.get_fastest_instance() #outputs result based on default arguments
> inst.get_fastest_instance(url, framework, network, dataset) #to make a custom call to function
> inst.get_similar_instances(url, framework, network, dataset)
> inst.get_cheapest_instance(url, framework, network, dataset)
> inst.predictor_sameRegion(url, instance, region)
> inst.predictor_anyRegion(url, instance, provider, region)
> inst.predictor_cheapest(url, instance, region)
> inst.predictor_cheapest2(url, region)
> inst.predictor_sameRegion2(url, instance, provider, region)
Example Runs
get_similar_instances()
predictor_cheapest() : input shows an AWS instance and the suggestor provides a cheaper instance on GCP.
Project Status
Ongoing
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for InstanceSuggestor-1.1.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af9e9dd0ac213a22f2880e832d645620efd93b8fffc60476fbc2a79d5cf23029 |
|
MD5 | f6e9ae13ead13d14279583bb1e8267d5 |
|
BLAKE2b-256 | 40e7d8049b1179964fac31aa127f447229ae08bc8c6e6480c4ac631537530be2 |