Skip to main content

Project with code needed to filter, trim and slim ntuples produced by AP

Project description

Description

This project is used to:

  • Filter, slim, trim the trees from a given AP production
  • Rename branches

This is done using configurations in a YAML file and through Ganga jobs.

Installation

This project cannot be installed and used from within a virtual environment. It depends on Ganga and therefore one has to be installed in $HOME/.local/ for this do:

. cvmfs/lhcb.cern.ch/lib/LbEnv

# Will install a few projects on top of what is already in the LHCb environment
pip install post_ap

# Make a proxy that lasts 100 hours
lhcb-proxy-init -v 100:00

In order to make Ganga aware of the post_ap package do:

import sys
import os

home_dir = os.environ['HOME']
sys.path.append(f'{home_dir}/.local/lib/python3.12/site-packages')
sys.path.append('/cvmfs/lhcb.cern.ch/lib/var/lib/LbEnv/3386/stable/linux-64/lib/python3.12/site-packages')

in .ganga.py, where the path will depend on the version of python used by the LHCb environment.

To check that this is working, open ganga and run:

from post_ap.pfn_reader        import PFNReader

Submitting jobs

For this one would run a line like:

job_filter_ganga -n job_name -p PRODUCTION -s SAMPLE -c /path/to/config/file.yaml -b BACKEND -v VERSION_OF_ENV 
  • The number of jobs will be equal to the number of PFNs, up to 500 jobs.
  • The code used to filter reside in the grid and the only thing the user has to do is to provide the latest version

Check latest version of virtual environment

The jobs below will run with code from a virtual environment that is already in the grid. One should use the latest version of this environment. To know the latest versions, run:

# In a separate terminal open a shell with access to dirac
post_shell

# Run this command for a list of environmets
list_venvs

The post_shell terminal won't be used to send jobs.

Config file

Here is where all the configuration goes and an example of a config can be found here

Optional

  • In order to improve the ganga experience use:
# Minimizes messages when opening ganga
# Does not start monitoring of jobs by default
alias ganga='ganga --quiet --no-mon'

in the $HOME/.bashrc file. Monitoring can be turned on by hand as explained here

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

post_ap-0.2.4.tar.gz (35.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

post_ap-0.2.4-py3-none-any.whl (45.0 kB view details)

Uploaded Python 3

File details

Details for the file post_ap-0.2.4.tar.gz.

File metadata

  • Download URL: post_ap-0.2.4.tar.gz
  • Upload date:
  • Size: 35.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for post_ap-0.2.4.tar.gz
Algorithm Hash digest
SHA256 c25fa5e175dc809110ceed44aaa13afccf925c109a17ea110fa6968e4de7c5d8
MD5 b0abe71aac01526aaa791aed14d8dd1e
BLAKE2b-256 785db81907ae5d519a2c9f53f158cb4317e6d9483fcdc4712133f4fdb35078b8

See more details on using hashes here.

Provenance

The following attestation bundles were made for post_ap-0.2.4.tar.gz:

Publisher: publish.yaml on acampove/post_ap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file post_ap-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: post_ap-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 45.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.0.1 CPython/3.12.8

File hashes

Hashes for post_ap-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 2cba1ff9ca42bb8eb073a437709c708a5081b1b5ba7b502c21e6968c738eaf6d
MD5 0f376f8904378efe370008fd55f6da1a
BLAKE2b-256 8b297f9698a76eaf2e7aac73f8e517c22602357898df3f36347c2fb7e0cf4c87

See more details on using hashes here.

Provenance

The following attestation bundles were made for post_ap-0.2.4-py3-none-any.whl:

Publisher: publish.yaml on acampove/post_ap

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page