Skip to main content

Auto scale AWS by spot instances to launch tasks

Project description

Autoscale AWS allows to scale up virtual machines by invoking spot requests as per start and stop rules.

Create a folder of tasks.
   /tasks/mytask01/
   /tasks/mytask02/
   /tasks/mytask03/


Autoscale will pick up those ones, launch AWS instances,
copy the folder to remote AWS, and launch main.sh on remote instances.
and stop them when the tasks are finished.


The results are stored in S3 folders and it can be retrieved
even the instances are closed on your local PC



Install process  from pip :

cd yourenv
pip install autoscale_aws

Configuration is in 
YOURHOME/.aws/



Install process  from github :

CURDIR=`pwd`
git clone https://github.com/arita37/autoscale_aws/
mkdir ${CURDIR}/venvs
Make sure virtualenv is installed
virtualenv -p python3 ${CURDIR}/venvs/autoscaleenv
source ${CURDIR}/venvs/autoscaleenv/bin/activate
cd ${CURDIR}/autoscale_aws

pip install -U pip
pip install -r requirements.txt
export PYTHONPATH=${CURDIR}/autoscale_aws/src:${PYTHONPATH}
python src/autoscale_aws/batch_daemon_autoscale_cli.py --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for autoscaleaws, version 11.0.2
Filename, size File type Python version Upload date Hashes
Filename, size autoscaleaws-11.0.2-py3-none-any.whl (48.1 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page