This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (pypi.python.org).
Help us improve Python packaging - Donate today!

Setup and manage a toil and Apache Mesos cluster in EC2

Project Description

The CGCloud plugin for Toil lets you setup a fully configured Toil/Mesos cluster in EC2 in just minutes, regardless of the number of nodes.

Prerequisites

The cgcloud-toil package requires that the cgcloud-core package and its prerequisites are present.

Installation

Read the entire section before pasting any commands and ensure that all prerequisites are installed. It is recommended to install this plugin into the virtualenv you created for CGCloud:

source ~/cgcloud/bin/activate
pip install cgcloud-toil

If you get DistributionNotFound: No distributions matching the version for cgcloud-toil, try running pip install --pre cgcloud-toil.

Be sure to configure cgcloud-core before proceeding.

Configuration

Modify your .profile or .bash_profile by adding the following line:

export CGCLOUD_PLUGINS="cgcloud.toil:$CGCLOUD_PLUGINS"

Login and out (or, on OS X, start a new Terminal tab/window).

Verify the installation by running:

cgcloud list-roles

The output should include the toil-box role.

Usage

Create a single t2.micro box to serve as the template for the cluster nodes:

cgcloud create -IT toil-box

The I option stops the box once it is fully set up and takes an image (AMI) of it. The T option terminates the box after that.

Substitute toil-latest-box for toil-box if you want to use the latest unstable release of Toil.

Now create a cluster by booting a leader and the workers from that AMI:

cgcloud create-cluster toil -s 2 -t m3.large

This will launch a leader and two workers using the m3.large instance type.

SSH into the leader:

cgcloud ssh toil-leader

… or the first worker:

cgcloud ssh -o 0 toil-worker

… or the second worker:

cgcloud ssh -o 1 toil-worker
Release History

Release History

This version
History Node

1.6.0

History Node

1.6.0a1.dev409

History Node

1.6.0a1.dev403

History Node

1.6.0a1.dev397

History Node

1.6.0a1.dev393

History Node

1.6.0a1.dev384

History Node

1.6.0a1.dev378

History Node

1.6.0a1.dev376

History Node

1.6.0a1.dev373

History Node

1.6.0a1.dev371

History Node

1.6.0a1.dev370

History Node

1.6.0a1.dev368

History Node

1.6.0a1.dev364

History Node

1.6.0a1.dev362

History Node

1.6.0a1.dev361

History Node

1.6.0a1.dev360

History Node

1.6.0a1.dev356

History Node

1.6.0a1.dev351

History Node

1.6.0a1.dev340

History Node

1.6.0a1.dev337

History Node

1.5.6

History Node

1.5.5

History Node

1.5.5a1.dev381

History Node

1.5.4

History Node

1.5.3

History Node

1.5.2

History Node

1.5.1

History Node

1.5.0

History Node

1.5.0a1.dev331

History Node

1.5.0a1.dev322

History Node

1.4.1

History Node

1.4.0

History Node

1.4a1.dev320

History Node

1.4a1.dev316

History Node

1.4a1.dev312

History Node

1.4a1.dev295

History Node

1.4a1.dev288

History Node

1.4a1.dev286

History Node

1.4a1.dev283

History Node

1.4a1.dev276

History Node

1.4a1.dev275

History Node

1.4a1.dev274

History Node

1.4a1.dev269

History Node

1.4a1.dev266

History Node

1.4a1.dev263

History Node

1.4a1.dev256

History Node

1.4a1.dev202

History Node

1.4a1.dev198

History Node

1.4a1.dev197

History Node

1.4a1.dev195

History Node

1.3.8

History Node

1.3.7

History Node

1.3.6

History Node

1.3.6a1.dev232

History Node

1.3.5

History Node

1.3.4

History Node

1.3.3

History Node

1.3.3a1.dev216

History Node

1.3.2

History Node

1.3.2a1.dev201

History Node

1.3.1a1.dev200

History Node

1.3

History Node

1.3a1.dev193

History Node

1.3a1.dev192

History Node

1.3a1.dev191

History Node

1.3a1.dev190

History Node

1.2.3

History Node

1.2.3.dev183

History Node

1.2.2

History Node

1.2.2a1.dev165

History Node

1.2.1a1.dev161

History Node

1.2

History Node

1.2a1.dev159

History Node

1.1a1.dev149

History Node

1.1a1.dev147

History Node

1.1a1.dev144

History Node

1.1a1.dev143

History Node

1.1a1.dev139

History Node

1.1a1.dev137

History Node

1.1a1.dev132

History Node

1.1a1.dev131

History Node

1.1a1.dev130

History Node

1.1a1.dev129

Download Files

Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

File Name & Checksum SHA256 Checksum Help Version File Type Upload Date
cgcloud_toil-1.6.0-py2.7.egg (16.6 kB) Copy SHA256 Checksum SHA256 2.7 Egg Nov 22, 2016
cgcloud-toil-1.6.0.tar.gz (6.8 kB) Copy SHA256 Checksum SHA256 Source Nov 22, 2016

Supported By

WebFaction WebFaction Technical Writing Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Rackspace Rackspace Cloud Servers DreamHost DreamHost Log Hosting