Skip to main content

Lightweight interface to launching jobs in the cloud

Project description

ncluster

By Yaroslav Bulatov and Andrew Shaw

import ncluster
task = ncluster.make_task(instance_type='p2.xlarge')
task.upload('myscript.py')
task.run('python myscript.py > out')
task.download('out')

Installation

Install pip, tmux, Python 3.6 (see below), then

pip install -r https://raw.githubusercontent.com/diux-dev/ncluster/master/requirements.txt
pip install ncluster

Extra

An example of installing pip/tmux/python 3.6 on MacOS

  1. Download Anaconda distribution following https://conda.io/docs/user-guide/install/index.html
  2. Install tmux through homebrew: https://brew.sh/, then brew install tmux

Then

conda create -n new python=3.6 -y
conda activate new

Extra Deps:

brew install fswatch

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ncluster-0.1.24.tar.gz (39.6 kB view hashes)

Uploaded Source

Built Distribution

ncluster-0.1.24-py3-none-any.whl (66.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page