Skip to main content

CTAO DPPS Simulation Production Pipeline

Project description

DPPS SimPipe: Integration and Release

The CTAO DPPS Simulation Production Pipeline (SimPipe) provides the software, workflows, and data models for generating accurate Monte Carlo simulations of the CTAO observatory.

Installation

The following installation procedures are implemented in the gitlab CI/CD pipeline:

  • simtools is installed using pip
  • CORSIKA is installed using a tar-file (currently downloaded from a cloud storage)
  • sim_telarray is installed using a tar-file (currently downloaded from a cloud storage); planned to be installed from gitlab
  • simulation model databases - no installed required; configuration of secrets for access

Download of corsika / sim_telarray is facilitated by a private upload to the DESY Sync&Share. Ask the maintainers to provide the token to you and define it in a .env file in this repository:

SOFTWARE_DOWNLOAD_SECRET=<the token received from the maintainers>

Then run make build-dev-docker to build the simpipe container locally.

SimPipe Maintainer Documentation

The following section is preliminary and the setup is still in development (especially a simplification of the updating process).

Updating submodules dpps-aiv-toolkit and simtools

The dpps-aiv-toolkit and simtools are submodules of the dpps-simpipe repository. To update them, follow these steps (identical for both):

cd dpps-aiv-toolkit
git checkout <branch-or-commit>
cd ..
git add dpps-aiv-toolkit
git commit -m "Update dpps-aiv-toolkit submodule to latest version"
git push

Updating SimPipe components

  1. simtools:
    • update the submodule in simtools to the latest version (see above)
    • update gammasimtools version in pyproject.toml
    • update gammasimtools version in chart/templates/bootstrapSimulationModel.yaml
    • update gammasimtools version in Dockerfile
  2. Production and model parameters (SimulationModels):
    • update SimulationModels version in ./chart/values.yaml
  3. CORSIKA and sim_telarray:
    • update versions in .gitlab-ci.yml (this is propagated into the docker file)
  4. For a new DPPS release:
    • update DPPS release version in aiv-config.yml

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ctao_simpipe-0.2.0.tar.gz (21.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ctao_simpipe-0.2.0-py3-none-any.whl (6.2 kB view details)

Uploaded Python 3

File details

Details for the file ctao_simpipe-0.2.0.tar.gz.

File metadata

  • Download URL: ctao_simpipe-0.2.0.tar.gz
  • Upload date:
  • Size: 21.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for ctao_simpipe-0.2.0.tar.gz
Algorithm Hash digest
SHA256 9d10dfe8f2ead5eb3ef58cd48b7b9db5703fb228aa55d2c555036e41f79676f8
MD5 65024ceac7a0d448d9a4973c022859d8
BLAKE2b-256 a447ba5e845e326079df6441a09c1cb2f45f90c26e656de670522569b85c6e00

See more details on using hashes here.

File details

Details for the file ctao_simpipe-0.2.0-py3-none-any.whl.

File metadata

  • Download URL: ctao_simpipe-0.2.0-py3-none-any.whl
  • Upload date:
  • Size: 6.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.11

File hashes

Hashes for ctao_simpipe-0.2.0-py3-none-any.whl
Algorithm Hash digest
SHA256 1ae785edbe24143fac900f0a2e6b03fbe7211c5590e99443099107cd6cd2f831
MD5 b4babd5a77444ad3a2be131b4621d838
BLAKE2b-256 4778f721c87fbbca6c21ef8adaf44dc466219a8d2d43196ff51dd1b2b3c75d07

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page