Skip to main content

Project with code needed to filter, trim and slim ntuples produced by AP

Project description

Description

This project is used to:

  • Filter, slim, trim the trees from a given AP production
  • Rename branches

This is done using configurations in a YAML file and through Ganga jobs.

Installation

This project cannot be installed and used from within a virtual environment. It depends on Ganga and therefore one has to be installed in $HOME/.local/ for this do:

. cvmfs/lhcb.cern.ch/lib/LbEnv

# Will install a few projects on top of what is already in the LHCb environment
pip install post_ap

# Make a proxy that lasts 100 hours
lhcb-proxy-init -v 100:00

In order to make Ganga aware of the post_ap package do:

import sys
import os

home_dir = os.environ['HOME']
sys.path.append(f'{home_dir}/.local/lib/python3.12/site-packages')
sys.path.append('/cvmfs/lhcb.cern.ch/lib/var/lib/LbEnv/3386/stable/linux-64/lib/python3.12/site-packages')

in .ganga.py, where the path will depend on the version of python used by the LHCb environment.

To check that this is working, open ganga and run:

from post_ap.pfn_reader        import PFNReader

Submitting jobs

For this one would run a line like:

job_filter_ganga -n job_name -p PRODUCTION -s SAMPLE -c /path/to/config/file.yaml -b BACKEND -v VERSION_OF_ENV 
  • The number of jobs will be equal to the number of PFNs, up to 500 jobs.
  • The code used to filter reside in the grid and the only thing the user has to do is to provide the latest version

Check latest version of virtual environment

The jobs below will run with code from a virtual environment that is already in the grid. One should use the latest version of this environment. To know the latest versions, run:

# In a separate terminal open a shell with access to dirac
post_shell

# Run this command for a list of environmets
list_venvs

The post_shell terminal won't be used to send jobs.

Config file

Here is where all the configuration goes and an example of a config can be found here

Optional

  • In order to improve the ganga experience use:
# Minimizes messages when opening ganga
# Does not start monitoring of jobs by default
alias ganga='ganga --quiet --no-mon'

in the $HOME/.bashrc file. Monitoring can be turned on by hand as explained here

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

post_ap-0.2.3.tar.gz (34.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

post_ap-0.2.3-py3-none-any.whl (44.8 kB view details)

Uploaded Python 3

File details

Details for the file post_ap-0.2.3.tar.gz.

File metadata

  • Download URL: post_ap-0.2.3.tar.gz
  • Upload date:
  • Size: 34.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for post_ap-0.2.3.tar.gz
Algorithm Hash digest
SHA256 3069a8acd1350c9bf5f6b58cadc4fab8d4bc98cdd3db1a5e8f4e7da0a2192caa
MD5 f21e072b848e0d1198f3af5d927ec1a8
BLAKE2b-256 05ce6bb71b30b71381143cd2c3d7cac0f2ad360f8e6f3c5095cdef1401e4359d

See more details on using hashes here.

Provenance

The following attestation bundles were made for post_ap-0.2.3.tar.gz:

Publisher: publish.yaml on acampove/post_ap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file post_ap-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: post_ap-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 44.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for post_ap-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 e9d39cb60e884e888696b56fe18e1d84f2c91cfc06c2018a035ba252355f79e8
MD5 9dfa5c6c3d28dad7b3387ad0c24bce44
BLAKE2b-256 31e1c7d440b36cb732534ba4722d593d5192d9a6c3cbf821cd8d546676881dec

See more details on using hashes here.

Provenance

The following attestation bundles were made for post_ap-0.2.3-py3-none-any.whl:

Publisher: publish.yaml on acampove/post_ap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page