Skip to main content

Unified interfaces to Computing Elements and batch systems for DIRAC / DiracX

Project description

interCEde

Unified interfaces to Computing Elements and batch systems for DIRAC / DiracX and beyond —
submit, monitor, retrieve — validated against containerized backends.

CI PyPI Python versions License


What is interCEde?

interCEde sits between Workload Management Systems, such as DiracX and the many resources where jobs actually run. It provides a single, consistent interface for talking to Computing Elements (CEs) and batch systems — submitting jobs, querying their status, and retrieving their outputs — regardless of which backend is on the other end.

The name is the job description: the library intercedes on WMS' behalf, acting between two parties so the rest of the stack never has to know whether it is talking to ARC, HTCondor, Slurm over SSH, or a process on the local machine.

Every interface ships with integration tests that run against containerized instances of the real backends, so a given CE type is verified against multiple versions and configurations rather than against a mock that drifts from reality.

Why it exists

  • One contract, many backends. Calling code submits a job the same way everywhere; the backend-specific quirks live behind the interface.
  • Composable resources. Backends combine — SSH + Slurm, SSH + HTCondor, ARC + HTCondor, or a plain local runner — and each combination is just another implementation of the same interface.
  • Tested against the real thing. Containerized Slurm, HTCondor, and ARC instances are spun up in CI so behavior is checked against actual schedulers, not stubs.
  • Version coverage. The same test suite runs across a matrix of backend versions to catch incompatibilities before they reach production.

Relationship to DIRAC / DiracX

interCEde is part of the DIRACGrid ecosystem and is designed to back the Computing Element layer used by DiracX. It can also be used standalone wherever a uniform interface to heterogeneous CEs and batch systems is useful.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

intercede-0.0.1a1.tar.gz (25.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

intercede-0.0.1a1-py3-none-any.whl (14.1 kB view details)

Uploaded Python 3

File details

Details for the file intercede-0.0.1a1.tar.gz.

File metadata

  • Download URL: intercede-0.0.1a1.tar.gz
  • Upload date:
  • Size: 25.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for intercede-0.0.1a1.tar.gz
Algorithm Hash digest
SHA256 00e9923887019a21c4ea9475a555f0fa2bca66bd3f6467aeeeca0c2a99228202
MD5 b78fb7f2ffeb71796dfd43d14d7929db
BLAKE2b-256 aee86ec2129aa995adf0237e22abe36cde1e50e13705e433d488bb3df3a06472

See more details on using hashes here.

Provenance

The following attestation bundles were made for intercede-0.0.1a1.tar.gz:

Publisher: deployment.yml on DIRACGrid/intercede

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file intercede-0.0.1a1-py3-none-any.whl.

File metadata

  • Download URL: intercede-0.0.1a1-py3-none-any.whl
  • Upload date:
  • Size: 14.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for intercede-0.0.1a1-py3-none-any.whl
Algorithm Hash digest
SHA256 29998d905b4379a74ab24683eadc3e2530593e68ad355d09314c5d7160f231e5
MD5 e33fa604b137bcdcf52b7440dd071db9
BLAKE2b-256 4d8cc38b89440447b551b2a3f816eaf9a4352b8ee0373a64c61472848aa5da3f

See more details on using hashes here.

Provenance

The following attestation bundles were made for intercede-0.0.1a1-py3-none-any.whl:

Publisher: deployment.yml on DIRACGrid/intercede

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page