Auto scale AWS by spot instances to launch tasks
Project description
Autoscale AWS allows to scale up virtual machines by invoking spot requests as per start and stop rules.
To publish
cd repo
python pypi.py pblish
Create a folder of tasks.
/tasks/mytask01/
/tasks/mytask02/
/tasks/mytask03/
Autoscale will pick up those ones, launch AWS instances,
copy the folder to remote AWS, and launch main.sh on remote instances.
and stop them when the tasks are finished.
The results are stored in S3 folders and it can be retrieved
even the instances are closed on your local PC
Install process from pip :
cd yourenv
pip install autoscale_aws
Configuration is in
YOURHOME/.aws/
Install process from github :
CURDIR=`pwd`
git clone https://github.com/arita37/autoscale_aws/
mkdir ${CURDIR}/venvs
Make sure virtualenv is installed
virtualenv -p python3 ${CURDIR}/venvs/autoscaleenv
source ${CURDIR}/venvs/autoscaleenv/bin/activate
cd ${CURDIR}/autoscale_aws
pip install -U pip
pip install -r requirements.txt
export PYTHONPATH=${CURDIR}/autoscale_aws/src:${PYTHONPATH}
python src/autoscale_aws/batch_daemon_autoscale_cli.py --help
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
autoscaleaws-12.0.2.tar.gz
(64.9 kB
view details)
Built Distribution
File details
Details for the file autoscaleaws-12.0.2.tar.gz
.
File metadata
- Download URL: autoscaleaws-12.0.2.tar.gz
- Upload date:
- Size: 64.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.15.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.1.0 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.6.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 619a2a92ecb0d8dcd58fce94070c6693d4ac7bc05937f1e16ab9135af85e1bc5 |
|
MD5 | 688ce46adc92527399190210f55b0ed3 |
|
BLAKE2b-256 | 361efda76f45335e00a97bae08370272ff310f83085d8d70251339eb790578b0 |
File details
Details for the file autoscaleaws-12.0.2-py3-none-any.whl
.
File metadata
- Download URL: autoscaleaws-12.0.2-py3-none-any.whl
- Upload date:
- Size: 74.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.15.0 pkginfo/1.4.2 requests/2.18.4 setuptools/39.1.0 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.6.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | fe4057aa64fc2ee4fb69e8507edcd749280f296cb7610a3fe9a9dcc4de3fa46f |
|
MD5 | 4673a195864b032ad4eca0c840cfda86 |
|
BLAKE2b-256 | 0599b7ac5d1b1c886568425464f20be53abba71493da2f0f5dc944476c33760b |