Skip to main content

Auto scale AWS by spot instances to launch tasks

Project description

Autoscale AWS allows to scale up virtual machines by invoking spot requests as per start and stop rules.

To publish
cd repo
python pypi.py  pblish


Create a folder of tasks.
   /tasks/mytask01/
   /tasks/mytask02/
   /tasks/mytask03/


Autoscale will pick up those ones, launch AWS instances,
copy the folder to remote AWS, and launch main.sh on remote instances.
and stop them when the tasks are finished.


The results are stored in S3 folders and it can be retrieved
even the instances are closed on your local PC



Install process  from pip :

cd yourenv
pip install autoscale_aws

Configuration is in 
YOURHOME/.aws/



Install process  from github :

CURDIR=`pwd`
git clone https://github.com/arita37/autoscale_aws/
mkdir ${CURDIR}/venvs
Make sure virtualenv is installed
virtualenv -p python3 ${CURDIR}/venvs/autoscaleenv
source ${CURDIR}/venvs/autoscaleenv/bin/activate
cd ${CURDIR}/autoscale_aws

pip install -U pip
pip install -r requirements.txt
export PYTHONPATH=${CURDIR}/autoscale_aws/src:${PYTHONPATH}
python src/autoscale_aws/batch_daemon_autoscale_cli.py --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

autoscaleaws-12.0.2.tar.gz (64.9 kB view details)

Uploaded Source

Built Distribution

autoscaleaws-12.0.2-py3-none-any.whl (74.0 kB view details)

Uploaded Python 3

File details

Details for the file autoscaleaws-12.0.2.tar.gz.

File metadata

  • Download URL: autoscaleaws-12.0.2.tar.gz
  • Upload date:
  • Size: 64.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.1.0 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.6.5

File hashes

Hashes for autoscaleaws-12.0.2.tar.gz
Algorithm Hash digest
SHA256 619a2a92ecb0d8dcd58fce94070c6693d4ac7bc05937f1e16ab9135af85e1bc5
MD5 688ce46adc92527399190210f55b0ed3
BLAKE2b-256 361efda76f45335e00a97bae08370272ff310f83085d8d70251339eb790578b0

See more details on using hashes here.

File details

Details for the file autoscaleaws-12.0.2-py3-none-any.whl.

File metadata

  • Download URL: autoscaleaws-12.0.2-py3-none-any.whl
  • Upload date:
  • Size: 74.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.15.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.1.0 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.6.5

File hashes

Hashes for autoscaleaws-12.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 fe4057aa64fc2ee4fb69e8507edcd749280f296cb7610a3fe9a9dcc4de3fa46f
MD5 4673a195864b032ad4eca0c840cfda86
BLAKE2b-256 0599b7ac5d1b1c886568425464f20be53abba71493da2f0f5dc944476c33760b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page