JIP pipeline library
Project description
JIP Pipeline system
===================
The JIP pipeline system is a python library and a set of command
line utilities that allows you to create batch-process based computational
pipeline that can be submitted and managed on a compute cluster or on
your local machine.
Installation
============
The `JIP documentation <http://pyjip.readthedocs.org/en/latest/>`_ contains
more detailed instructions on installation and, more importantly, configuration
of the system and your compute infrastructure. Here is the very quick guide::
$> pip install pyjip
or
$> python setup.py install
If you want to install from *pypi* or the git repository. Afterwards, you have
to create configuration file ``$HOME/.jip/jip.json`` and add the following
content::
{
"cluster": "<class_name>"
}
Replace ``<class_name>`` with the name of the class that implements support
for your compute cluster. JIP ships with the following implementations:
* ``jip.cluster.SGE`` for *Sun Grid Engine*
* ``jip.cluster.Slurm`` for *Slurm*
* ``jip.cluster.PBS`` for *PBS* and *Torque*
* ``jip.cluster.LSF`` for *Platform LSF* and *Open Lava*
* ``jip.grids.JIP`` for JIPs' internal scheduler. If you use this, make
sure to start the JIP server on the same machine using the ``jip server``
command. Please note also that you have to install *pyzmq* if you want
to run the JIP server.
Documentation
=============
`Documentation <http://pyjip.readthedocs.org/en/latest/>`_ on installation and
usage can be found at http://pyjip.readthedocs.org/en/latest/.
Source Code
===========
The JIP source code can be found on
`GitHub <https://github.com/thasso/pyjip>`_.
Bugs and feature requests
=========================
Please feel free to use the `issue tracker
<https://github.com/thasso/pyjip/issued>`_ to file bug reports and feature
requests.
Changelog
=========
* 0.3 :
- Added auto-naming support for anonymous jobs that are assigned to variables.
The variable name is used as default job name
- Lots of changes to the internals
* 0.2 :
- Added explicit UTF-8 encoding for the dependency tree
* 0.1 : Initial release
Licences
========
JIP is licensed under the BSD license.
===================
The JIP pipeline system is a python library and a set of command
line utilities that allows you to create batch-process based computational
pipeline that can be submitted and managed on a compute cluster or on
your local machine.
Installation
============
The `JIP documentation <http://pyjip.readthedocs.org/en/latest/>`_ contains
more detailed instructions on installation and, more importantly, configuration
of the system and your compute infrastructure. Here is the very quick guide::
$> pip install pyjip
or
$> python setup.py install
If you want to install from *pypi* or the git repository. Afterwards, you have
to create configuration file ``$HOME/.jip/jip.json`` and add the following
content::
{
"cluster": "<class_name>"
}
Replace ``<class_name>`` with the name of the class that implements support
for your compute cluster. JIP ships with the following implementations:
* ``jip.cluster.SGE`` for *Sun Grid Engine*
* ``jip.cluster.Slurm`` for *Slurm*
* ``jip.cluster.PBS`` for *PBS* and *Torque*
* ``jip.cluster.LSF`` for *Platform LSF* and *Open Lava*
* ``jip.grids.JIP`` for JIPs' internal scheduler. If you use this, make
sure to start the JIP server on the same machine using the ``jip server``
command. Please note also that you have to install *pyzmq* if you want
to run the JIP server.
Documentation
=============
`Documentation <http://pyjip.readthedocs.org/en/latest/>`_ on installation and
usage can be found at http://pyjip.readthedocs.org/en/latest/.
Source Code
===========
The JIP source code can be found on
`GitHub <https://github.com/thasso/pyjip>`_.
Bugs and feature requests
=========================
Please feel free to use the `issue tracker
<https://github.com/thasso/pyjip/issued>`_ to file bug reports and feature
requests.
Changelog
=========
* 0.3 :
- Added auto-naming support for anonymous jobs that are assigned to variables.
The variable name is used as default job name
- Lots of changes to the internals
* 0.2 :
- Added explicit UTF-8 encoding for the dependency tree
* 0.1 : Initial release
Licences
========
JIP is licensed under the BSD license.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pyjip-0.3.tar.gz
(154.9 kB
view details)
File details
Details for the file pyjip-0.3.tar.gz
.
File metadata
- Download URL: pyjip-0.3.tar.gz
- Upload date:
- Size: 154.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c795f04c2159d470b0368663100237a8d5e6ee78bee98094aa3640861485e472 |
|
MD5 | 69a344a801df8da9ebc368b16fa29688 |
|
BLAKE2b-256 | 029ab537ddb89afca7cced2a51034af7cb48de8a0699a581216b90deec5a1777 |