Skip to main content

PyPI GitHub release (latest by date including pre-releases) Versions PyPI - License GitHub issues GitHub pull requests

IceProd

image

Description
IceCube dataset management system
Authors
WIPAC Developers / developers@icecube.wisc.edu
Keywords
WIPAC  ·  batch  ·  workload
URLs
Homepage  ·  Tracker  ·  Source

IceProd is a Python framework for distributed management of batch jobs. It runs as a layer on top of other batch middleware, such as HTCondor, and can pool together resources from different batch systems. The primary purpose is to coordinate and administer many large sets of jobs at once, keeping a history of the entire job lifecycle.

See also: Aartsen, Mark G., et al. "The IceProd framework: Distributed data processing for the IceCube neutrino observatory." Journal of parallel and distributed computing 75 (2015): 198-211.

Note:

For IceCube users with CVMFS access, IceProd is already installed. To load the environment execute:

/cvmfs/icecube.wisc.edu/iceprod/latest/env-shell.sh

or:

eval `/cvmfs/icecube.wisc.edu/iceprod/latest/setup.sh`

depending on whether you want to get a new shell or load the variables into the current shell.

Installation

Platforms:

IceProd should run on any Unix-like platform, although only Linux has been extensively tested and can be recommented for production deployment.

Prerequisites:

Listed here are any packages outside pip:

  • Python 3.7+
  • MongoDB 3.6+ (for the REST API)
  • nginx (for ssl offloading and better security)
  • globus (for data transfer)

Installation:

From the latest release:

Get the tarball link from https://github.com/WIPACrepo/iceprod/releases/latest

Then install like:

pip install https://github.com/WIPACrepo/iceprod/archive/v2.0.0.tar.gz

Installing from master:

If you must install the dev version from master, do:

pip install --upgrade git+git://github.com/WIPACrepo/iceprod.git#egg=iceprod

Metadata

Release files for iceprod 3.2.44

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for iceprod 3.2.44
File Size Uploaded Provenance Actions
iceprod-3.2.44.tar.gz 6.6 MB Without provenance Details for iceprod-3.2.44.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for iceprod 3.2.44
File Interpreter ABI Platform Actions
iceprod-3.2.44-py3-none-any.whl Python 3 none any Details for iceprod-3.2.44-py3-none-any.whl

Total release size: 7.2 MB

Release files / iceprod-3.2.44.tar.gz

Download URL iceprod-3.2.44.tar.gz
Size 6.6 MB
Tags Source
SHA-256 checksum
How to use checksums
b6c79a748af3f6b79694ca4c7ae6457afe8aff0a79855db30e576463c8bf09ba
BLAKE2b-256 checksum
How to use checksums
929b31af0b28cc0e2137d30f77f227c9c84e2c27f2e9caaf8b5e115f53c1eba9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Release files / iceprod-3.2.44-py3-none-any.whl

Download URL iceprod-3.2.44-py3-none-any.whl
Size 582.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0fa30e47c0bdb221965e29f22fc53d6a48434083642ba4d6505adf6139116362
BLAKE2b-256 checksum
How to use checksums
2ffa220aa46e56bfaff087c4e1dec0827526322341119108058b3923cae817c8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Security for iceprod 3.2.44

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

3.2.44 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page