Skip to main content
Help improve PyPI by participating in a 5-minute user interface survey!

P* Pilot-Job Implementation based on SAGA-Python

Project Description

BigJob
=============

The SAGA BigJob framework is a SAGA-based pilot job implementation. The Simple API for Grid Applications (SAGA) is a high-level, easy-to-use API for accessing distributed resources. SAGA BigJob supports a wide range of application types, and is usable over a broad range of infrastructures, i.e., it is general-purpose, extensible and interoperable. Unlike other common pilot job systems SAGA BigJob
(i) natively supports MPI job and
(ii) works on a variety of back-end systems, generally reflecting the advantage of using a SAGA-based approach.



Web Page & Mailing List
-----------------------

Web page: <http://saga-project.github.io/BigJob/>

Mailing list:

[bigjob-user@googlegroups.com](http://groups.google.com/group/bigjob-users)

[bigjob-devel@googlegroups.com](http://groups.google.com/group/bigjob-devel)


Installation
-------------

$ curl https://raw.github.com/saga-project/BigJob/master/bootstrap/bigjob-bootstrap.py -o bigjob-bootstrap.py
$ python bigjob-bootstrap.py $HOME/.bigjob/python/
$ . $HOME/.bigjob/python/bin/activate

See https://github.com/saga-project/BigJob/wiki/ for further information. The Wiki includes among many things information on how to setup BigJob on various machines, e.g. on XSEDE (Ranger, Kraken) or FutureGrid.


Configuration of Redis Coordination Backend
-------------------------------------

BigJob requires [Redis](http://redis.io) for communication between BigJob manager/agent. Use the following steps to install Redis.

Mac Homebrew:

brew install redis redis-tools

Linux:
Download Redis http://redis.io/download
Currently only tested with Redis 2.2.12

$ tar -xzvf redis-2.2.12.tar.gz
$ cd redis-2.2.12
$ make
$ make install (if root)


Start Redis (redis-server executable is located in src/ dir):

cd src
./redis-server

Examples:
-------------------------------------

<https://github.com/saga-project/BigJob/tree/master/examples/pilot-api>

Please modify COORDINATION_URL on top of example to the correct Redis backend!

Development & Packaging
-------------------------------------

Requirements:

* setuptools >0.6c11, http://pypi.python.org/pypi/setuptools

* setuptools-git >0.3.3, http://pypi.python.org/pypi/setuptools-git/

Building PyPi package

python setup.py build

Upload to PyPi

python setup.py sdist upload

Release history Release notifications

This version
History Node

0.54.post73

History Node

0.54

History Node

0.54-42-g09ea8bc

History Node

0.54-40-g398374a

History Node

0.54-25-g2a012bd

History Node

0.54-24-gf53e90b

History Node

0.54-21-g7012c7d

History Node

0.54-17-g6bc7aec

History Node

0.54-3-g2c96be7

History Node

0.54-2-g83c462e

History Node

0.54-1-g6531aad

History Node

0.52-12-g8bfd54b

History Node

0.52-11-g0c6f484

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
BigJob2-0.54.post73.tar.gz (30.3 MB) Copy SHA256 hash SHA256 Source None Aug 30, 2015

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page