IceProd

_Description: _{IceCube dataset management system}
_Authors: _{WIPAC Developers / developers@icecube.wisc.edu}
_Keywords: _{WIPAC · batch · workload}
_URLs: _{Homepage · Tracker · Source}

IceProd is a Python framework for distributed management of batch jobs. It runs as a layer on top of other batch middleware, such as HTCondor, and can pool together resources from different batch systems. The primary purpose is to coordinate and administer many large sets of jobs at once, keeping a history of the entire job lifecycle.

See also: Aartsen, Mark G., et al. "The IceProd framework: Distributed data processing for the IceCube neutrino observatory." Journal of parallel and distributed computing 75 (2015): 198-211.

Note:

For IceCube users with CVMFS access, IceProd is already installed. To load the environment execute:

/cvmfs/icecube.wisc.edu/iceprod/latest/env-shell.sh

or:

eval `/cvmfs/icecube.wisc.edu/iceprod/latest/setup.sh`

depending on whether you want to get a new shell or load the variables into the current shell.

Installation

Platforms:

IceProd should run on any Unix-like platform, although only Linux has been extensively tested and can be recommented for production deployment.

Prerequisites:

Listed here are any packages outside pip:

Python 3.7+
MongoDB 3.6+ (for the REST API)
nginx (for ssl offloading and better security)
globus (for data transfer)

Installation:

From the latest release:

Get the tarball link from https://github.com/WIPACrepo/iceprod/releases/latest

Then install like:

pip install https://github.com/WIPACrepo/iceprod/archive/v2.0.0.tar.gz

Installing from master:

If you must install the dev version from master, do:

pip install --upgrade git+git://github.com/WIPACrepo/iceprod.git#egg=iceprod

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iceprod-3.2.41.tar.gz (6.6 MB view details)

Uploaded Sep 3, 2026 Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files.

iceprod-3.2.41-py3-none-any.whl (579.0 kB view details)

Uploaded Sep 3, 2026 Python 3

File details

Details for the file iceprod-3.2.41.tar.gz.

File metadata

Download URL: iceprod-3.2.41.tar.gz
Upload date: Sep 3, 2026
Size: 6.6 MB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for iceprod-3.2.41.tar.gz
Algorithm	Hash digest
SHA256	`2f8d982e3793757d6471c969810754efb70367741f9b5510c6aea44af1bbbbbe`
MD5	`a2b18db87618000baf9fd7ab558530db`
BLAKE2b-256	`6644704bd9b82aef6d26da97af206991833feb57e1a0f5479e9cf4d86d3b2e73`

See more details on using hashes here.

File details

Details for the file iceprod-3.2.41-py3-none-any.whl.

File metadata

Download URL: iceprod-3.2.41-py3-none-any.whl
Upload date: Sep 3, 2026
Size: 579.0 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for iceprod-3.2.41-py3-none-any.whl
Algorithm	Hash digest
SHA256	`9f5e24a7916a915ba02ca72fbc22d4d63c1a3dc959e57a62d3a5fe2ab97390a1`
MD5	`218e73f405fa66809db433595a99c1da`
BLAKE2b-256	`3eb5407969887a7d4ff96ae6e350c2a16aa07495b2be2235f13d88bf56789eeb`