Skip to main content

PyPI GitHub release (latest by date including pre-releases) Versions PyPI - License GitHub issues GitHub pull requests

IceProd

image

Description
IceCube dataset management system
Authors
WIPAC Developers / developers@icecube.wisc.edu
Keywords
WIPAC  ·  batch  ·  workload
URLs
Homepage  ·  Tracker  ·  Source

IceProd is a Python framework for distributed management of batch jobs. It runs as a layer on top of other batch middleware, such as HTCondor, and can pool together resources from different batch systems. The primary purpose is to coordinate and administer many large sets of jobs at once, keeping a history of the entire job lifecycle.

See also: Aartsen, Mark G., et al. "The IceProd framework: Distributed data processing for the IceCube neutrino observatory." Journal of parallel and distributed computing 75 (2015): 198-211.

Note:

For IceCube users with CVMFS access, IceProd is already installed. To load the environment execute:

/cvmfs/icecube.wisc.edu/iceprod/latest/env-shell.sh

or:

eval `/cvmfs/icecube.wisc.edu/iceprod/latest/setup.sh`

depending on whether you want to get a new shell or load the variables into the current shell.

Installation

Platforms:

IceProd should run on any Unix-like platform, although only Linux has been extensively tested and can be recommented for production deployment.

Prerequisites:

Listed here are any packages outside pip:

  • Python 3.7+
  • MongoDB 3.6+ (for the REST API)
  • nginx (for ssl offloading and better security)
  • globus (for data transfer)

Installation:

From the latest release:

Get the tarball link from https://github.com/WIPACrepo/iceprod/releases/latest

Then install like:

pip install https://github.com/WIPACrepo/iceprod/archive/v2.0.0.tar.gz

Installing from master:

If you must install the dev version from master, do:

pip install --upgrade git+git://github.com/WIPACrepo/iceprod.git#egg=iceprod

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iceprod-3.2.39.tar.gz (6.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

iceprod-3.2.39-py3-none-any.whl (578.8 kB view details)

Uploaded Python 3

File details

Details for the file iceprod-3.2.39.tar.gz.

File metadata

  • Download URL: iceprod-3.2.39.tar.gz
  • Upload date:
  • Size: 6.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for iceprod-3.2.39.tar.gz
Algorithm Hash digest
SHA256 3f7a9405bf6420744303a1ed8fe0278ec14e7436cb28ea4e5fd56d37c587b905
MD5 a8c60c4bb1bb3c1308c2d35e5e48dd7b
BLAKE2b-256 476fda926bb5f0649f707aa114df8e3c9fa810a7955a0a339e3aa379702f6200

See more details on using hashes here.

File details

Details for the file iceprod-3.2.39-py3-none-any.whl.

File metadata

  • Download URL: iceprod-3.2.39-py3-none-any.whl
  • Upload date:
  • Size: 578.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for iceprod-3.2.39-py3-none-any.whl
Algorithm Hash digest
SHA256 ef9720e40a6a9189b6a8088ba0d9becb615e4febee35ca674825a413a25188e2
MD5 a24eda67f926eef04d5aa33ffa0f433e
BLAKE2b-256 d6cb52f9eecffd1b0c96492ec2e4123c9e07adea22d3aa1dbea8cb0c74cba149

See more details on using hashes here.

Release history Release notifications | RSS feed

3.2.41

2 files

3.2.40

2 files

This release

3.2.39 This release

2 files

3.2.38

2 files

3.2.37

2 files

3.2.36

2 files

3.2.35

2 files

3.2.34

2 files

3.2.33

2 files

3.2.32

2 files

3.2.31

2 files

3.2.30

2 files

3.2.29

2 files

3.2.28

2 files

3.2.27

2 files

3.2.26

2 files

3.2.25

2 files

3.2.24

2 files

3.2.23

2 files

3.2.22

2 files

3.2.21

2 files

3.2.20

2 files

3.2.19

2 files

3.2.18

2 files

3.2.17

2 files

3.2.16

2 files

3.2.15

2 files

3.2.14

2 files

3.2.13

2 files

3.2.12

2 files

3.2.11

2 files

3.2.10

2 files

3.2.9

2 files

3.2.8

2 files

3.2.7

2 files

3.2.6

2 files

3.2.5

2 files

3.2.4

2 files

3.2.3

2 files

3.2.2

2 files

3.2.1

2 files

3.2.0

2 files

3.1.13

2 files

3.1.12

2 files

3.1.11

2 files

3.1.10

2 files

3.1.9

2 files

3.1.8

2 files

3.1.7

2 files

3.1.6

2 files

3.1.5

2 files

3.1.4

2 files

3.1.3

2 files

3.1.2

2 files

3.1.1

2 files

3.1.0

2 files

3.0.55

2 files

3.0.54

2 files

3.0.53

2 files

3.0.52

2 files

3.0.51

2 files

3.0.50

2 files

3.0.49

2 files

3.0.48

2 files

3.0.47

2 files

3.0.46

2 files

3.0.45

2 files

3.0.44

2 files

3.0.43

2 files

3.0.42

2 files

3.0.41

2 files

3.0.40

2 files

3.0.39

2 files

3.0.38

2 files

3.0.37

2 files

3.0.36

2 files

3.0.35

2 files

3.0.34

2 files

3.0.33

2 files

3.0.32

2 files

3.0.31

2 files

3.0.30

2 files

3.0.29

2 files

3.0.28

2 files

3.0.27

2 files

3.0.26

2 files

3.0.25

2 files

3.0.24

2 files

3.0.23

2 files

3.0.22

2 files

3.0.21

2 files

3.0.20

2 files

3.0.19

2 files

3.0.18

2 files

3.0.17

2 files

3.0.16

2 files

3.0.15

2 files

3.0.14

2 files

3.0.13

2 files

3.0.12

2 files

3.0.11

2 files

3.0.10

2 files

3.0.9

2 files

3.0.8

2 files

3.0.7

2 files

3.0.6

2 files

3.0.5

2 files

3.0.4

2 files

3.0.3

2 files

3.0.2

2 files

3.0.1

2 files

3.0.0

2 files

2.7.14

2 files

2.7.13

2 files

2.7.12

2 files

2.7.11

2 files

2.7.10

2 files

2.7.9

2 files

2.7.8

2 files

2.7.7

2 files

2.7.6

2 files

2.7.5

2 files

2.7.4

2 files

2.7.3

2 files

2.7.2

2 files

2.7.1

2 files

2.7.0

2 files

2.6.17

2 files

2.6.16

2 files

2.6.15

2 files

2.6.14

2 files

2.6.13

2 files

2.6.12

2 files

2.6.11

2 files

2.6.10

2 files

2.6.9

2 files

2.6.8

2 files

2.6.7

2 files

2.6.6

2 files

2.6.5

2 files

2.6.4

2 files

2.6.3

2 files

2.6.2

2 files

2.6.1

2 files

2.6.0

2 files

2.5.23

2 files

2.5.22

2 files

2.5.21

2 files

2.5.20

2 files

2.5.19

2 files

2.5.18

2 files

2.5.17

2 files

2.5.16

2 files

2.5.15

2 files

2.5.14

2 files

2.5.13

2 files

2.5.12

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page