Skip to main content

PyPI GitHub release (latest by date including pre-releases) Versions PyPI - License GitHub issues GitHub pull requests

IceProd

image

Description
IceCube dataset management system
Authors
WIPAC Developers / developers@icecube.wisc.edu
Keywords
WIPAC  ·  batch  ·  workload
URLs
Homepage  ·  Tracker  ·  Source

IceProd is a Python framework for distributed management of batch jobs. It runs as a layer on top of other batch middleware, such as HTCondor, and can pool together resources from different batch systems. The primary purpose is to coordinate and administer many large sets of jobs at once, keeping a history of the entire job lifecycle.

See also: Aartsen, Mark G., et al. "The IceProd framework: Distributed data processing for the IceCube neutrino observatory." Journal of parallel and distributed computing 75 (2015): 198-211.

Note:

For IceCube users with CVMFS access, IceProd is already installed. To load the environment execute:

/cvmfs/icecube.wisc.edu/iceprod/latest/env-shell.sh

or:

eval `/cvmfs/icecube.wisc.edu/iceprod/latest/setup.sh`

depending on whether you want to get a new shell or load the variables into the current shell.

Installation

Platforms:

IceProd should run on any Unix-like platform, although only Linux has been extensively tested and can be recommented for production deployment.

Prerequisites:

Listed here are any packages outside pip:

  • Python 3.7+
  • MongoDB 3.6+ (for the REST API)
  • nginx (for ssl offloading and better security)
  • globus (for data transfer)

Installation:

From the latest release:

Get the tarball link from https://github.com/WIPACrepo/iceprod/releases/latest

Then install like:

pip install https://github.com/WIPACrepo/iceprod/archive/v2.0.0.tar.gz

Installing from master:

If you must install the dev version from master, do:

pip install --upgrade git+git://github.com/WIPACrepo/iceprod.git#egg=iceprod

Metadata

Release files for iceprod 3.2.43

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for iceprod 3.2.43
File Size Uploaded Provenance Actions
iceprod-3.2.43.tar.gz 6.6 MB Without provenance Details for iceprod-3.2.43.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for iceprod 3.2.43
File Interpreter ABI Platform Actions
iceprod-3.2.43-py3-none-any.whl Python 3 none any Details for iceprod-3.2.43-py3-none-any.whl

Total release size: 7.2 MB

Release files / iceprod-3.2.43.tar.gz

Download URL iceprod-3.2.43.tar.gz
Size 6.6 MB
Tags Source
SHA-256 checksum
How to use checksums
2be32935ce925fa36885ab7d79ce9ce9c64f14097e17c8f85dc6071c19c8d5e2
BLAKE2b-256 checksum
How to use checksums
005dfc799c3a4bb19412b000bef8cd0842a3aa29d91ae8e8acbc214ba62a26ce
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Release files / iceprod-3.2.43-py3-none-any.whl

Download URL iceprod-3.2.43-py3-none-any.whl
Size 582.3 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0ee3c75c75973d96256634f61d6411e92eef5064b46b72a13b9abc4ccf6e5d35
BLAKE2b-256 checksum
How to use checksums
ed5e09489077c03cf02a64fb4a351f5d2d234eb60aff41df7b4b6a5d134c57cc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Security for iceprod 3.2.43

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

3.2.43 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page