Skip to main content

PixelPatrol SLURM Cluster (pixel-patrol-slurm)

Launches a Dask SLURMCluster, waits for workers to come online, then runs pixel-patrol process against the cluster.

Installation

uv pip install pixel-patrol-slurm

Usage

pixel-patrol-slurm [SLURM options] -- BASE_DIR [pixel-patrol process options]

Arguments before -- control the Slurm cluster. Arguments after -- are passed verbatim to pixel-patrol process (--scheduler is injected automatically).

Examples

# Minimal - use defaults (4 jobs, 4 cores, 16 GB, 2 h walltime)
pixel-patrol-slurm -- /data/images --output results.parquet

# Custom cluster
pixel-patrol-slurm --jobs 16 --cores 4 --memory 32GB --partition gpu \
  -- /data/images --output results.parquet --flavor myproject

# Short walltime, fewer jobs
pixel-patrol-slurm --walltime 04:00:00 --jobs 8 \
  -- /data/images -o out.parquet --processors-exclude raster-histogram

Options

Flag Default Description
--jobs 4 Number of Slurm jobs (workers) to submit
--cores 4 CPU cores per job
--memory 16GB Memory per job
--partition (none) Slurm partition / queue name
--walltime 02:00:00 Job walltime HH:MM:SS
--processes 1 Dask worker processes per job
--wait 60 Seconds to wait for workers to start
--min-workers 1 Minimum workers before proceeding
--env-extra (none) Extra environment string, e.g. 'module load cuda'

Metadata

Release files for pixel-patrol-slurm 1.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pixel-patrol-slurm 1.0.1
File Size Uploaded Provenance
pixel_patrol_slurm-1.0.1.tar.gz 3.6 kB Without provenance Details

Built distribution (wheel)

Table of built distributions (wheels) for pixel-patrol-slurm 1.0.1
File Interpreter ABI Platform
pixel_patrol_slurm-1.0.1-py3-none-any.whl Python 3 none any Details

Total release size: 8.4 kB

Release files / pixel_patrol_slurm-1.0.1.tar.gz

Download URL pixel_patrol_slurm-1.0.1.tar.gz
Size 3.6 kB
Tags Source
SHA-256 checksum
How to use checksums
7c5b0061300eac86c89d81cb03198455820536801e108724b478a0fcfe686f43
BLAKE2b-256 checksum
How to use checksums
3e405c8bcc6223faf868bb2f51752ed30f3da49011ffe4965cf9e6737a2fbee8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Release files / pixel_patrol_slurm-1.0.1-py3-none-any.whl

Download URL pixel_patrol_slurm-1.0.1-py3-none-any.whl
Size 4.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3d8afaf13e21f36532f60677baea442f955319d2236f8230868bc6b18e09ba17
BLAKE2b-256 checksum
How to use checksums
6a0a5ab134ab6158d3502a92407249db5b64b4e0aadfe168d40c6bc3af5a6c73
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.2.0 CPython/3.12.3

Security for pixel-patrol-slurm 1.0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page