Skip to main content

JIP pipeline library

Project description

JIP Pipeline system
===================
The JIP pipeline system is a python library and a set of command
line utilities that allows you to create batch-process based computational
pipeline that can be submitted and managed on a compute cluster or on
your local machine.

Installation
============
The `JIP documentation <http://pyjip.readthedocs.org/en/latest/>`_ contains
more detailed instructions on installation and, more importantly, configuration
of the system and your compute infrastructure. Here is the very quick guide::

$> pip install pyjip

or

$> python setup.py install

If you want to install from *pypi* or the git repository. Afterwards, you have
to create configuration file ``$HOME/.jip/jip.json`` and add the following
content::

{
"cluster": "<class_name>"
}

Replace ``<class_name>`` with the name of the class that implements support
for your compute cluster. JIP ships with the following implementations:

* ``jip.cluster.SGE`` for *Sun Grid Engine*

* ``jip.cluster.Slurm`` for *Slurm*

* ``jip.cluster.PBS`` for *PBS* and *Torque*

* ``jip.cluster.LSF`` for *Platform LSF* and *Open Lava*

* ``jip.grids.JIP`` for JIPs' internal scheduler. If you use this, make
sure to start the JIP server on the same machine using the ``jip server``
command. Please note also that you have to install *pyzmq* if you want
to run the JIP server.

Documentation
=============
`Documentation <http://pyjip.readthedocs.org/en/latest/>`_ on installation and
usage can be found at http://pyjip.readthedocs.org/en/latest/.

Source Code
===========
The JIP source code can be found on
`GitHub <https://github.com/thasso/pyjip>`_.

Bugs and feature requests
=========================
Please feel free to use the `issue tracker
<https://github.com/thasso/pyjip/issued>`_ to file bug reports and feature
requests.

Changelog
=========
* 0.3 :
- Added auto-naming support for anonymous jobs that are assigned to variables.
The variable name is used as default job name
- Lots of changes to the internals

* 0.2 :
- Added explicit UTF-8 encoding for the dependency tree

* 0.1 : Initial release

Licences
========
JIP is licensed under the BSD license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyjip-0.3.tar.gz (154.9 kB view details)

Uploaded Source

File details

Details for the file pyjip-0.3.tar.gz.

File metadata

  • Download URL: pyjip-0.3.tar.gz
  • Upload date:
  • Size: 154.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for pyjip-0.3.tar.gz
Algorithm Hash digest
SHA256 c795f04c2159d470b0368663100237a8d5e6ee78bee98094aa3640861485e472
MD5 69a344a801df8da9ebc368b16fa29688
BLAKE2b-256 029ab537ddb89afca7cced2a51034af7cb48de8a0699a581216b90deec5a1777

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page