Skip to main content

PyPI GitHub release (latest by date including pre-releases) Versions PyPI - License GitHub issues GitHub pull requests

IceProd

image

Description
IceCube dataset management system
Authors
WIPAC Developers / developers@icecube.wisc.edu
Keywords
WIPAC  ·  batch  ·  workload
URLs
Homepage  ·  Tracker  ·  Source

IceProd is a Python framework for distributed management of batch jobs. It runs as a layer on top of other batch middleware, such as HTCondor, and can pool together resources from different batch systems. The primary purpose is to coordinate and administer many large sets of jobs at once, keeping a history of the entire job lifecycle.

See also: Aartsen, Mark G., et al. "The IceProd framework: Distributed data processing for the IceCube neutrino observatory." Journal of parallel and distributed computing 75 (2015): 198-211.

Note:

For IceCube users with CVMFS access, IceProd is already installed. To load the environment execute:

/cvmfs/icecube.wisc.edu/iceprod/latest/env-shell.sh

or:

eval `/cvmfs/icecube.wisc.edu/iceprod/latest/setup.sh`

depending on whether you want to get a new shell or load the variables into the current shell.

Installation

Platforms:

IceProd should run on any Unix-like platform, although only Linux has been extensively tested and can be recommented for production deployment.

Prerequisites:

Listed here are any packages outside pip:

  • Python 3.7+
  • MongoDB 3.6+ (for the REST API)
  • nginx (for ssl offloading and better security)
  • globus (for data transfer)

Installation:

From the latest release:

Get the tarball link from https://github.com/WIPACrepo/iceprod/releases/latest

Then install like:

pip install https://github.com/WIPACrepo/iceprod/archive/v2.0.0.tar.gz

Installing from master:

If you must install the dev version from master, do:

pip install --upgrade git+git://github.com/WIPACrepo/iceprod.git#egg=iceprod

Metadata

Release files for iceprod 3.2.46

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for iceprod 3.2.46
File Size Uploaded Provenance Actions
iceprod-3.2.46.tar.gz 6.6 MB Without provenance Details for iceprod-3.2.46.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for iceprod 3.2.46
File Interpreter ABI Platform Actions
iceprod-3.2.46-py3-none-any.whl Python 3 none any Details for iceprod-3.2.46-py3-none-any.whl

Total release size: 7.2 MB

Release files / iceprod-3.2.46.tar.gz

Download URL iceprod-3.2.46.tar.gz
Size 6.6 MB
Tags Source
SHA-256 checksum
How to use checksums
55025d7fee76df346f0e16e6a55b054bc676e51286243c3c4d672830c9429eed
BLAKE2b-256 checksum
How to use checksums
433542ad9ed934687a5b57632b19242b0168bccb5c54d98035cd6ecafb57dae0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Release files / iceprod-3.2.46-py3-none-any.whl

Download URL iceprod-3.2.46-py3-none-any.whl
Size 588.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
aa1bd1a66801639588544f15fdd9970b5933f92d080eb2c3ec61ccef02267c73
BLAKE2b-256 checksum
How to use checksums
20b337a0789b903b240cc98cc617fcfa71c36188c1dd428abaa3de4ba5b3db55
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Security for iceprod 3.2.46

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

3.2.46 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page