Project with code needed to filter, trim and slim ntuples produced by AP
Project description
Description
This project is used to:
- Filter, slim, trim the trees from a given AP production
- Rename branches
This is done using configurations in a YAML file and through Ganga jobs.
Installation
This project cannot be installed and used from within a virtual environment. It depends on Ganga
and therefore one has to be installed in $HOME/.local/ for this do:
. cvmfs/lhcb.cern.ch/lib/LbEnv
# Will install a few projects on top of what is already in the LHCb environment
pip install post_ap
# Make a proxy that lasts 100 hours
lhcb-proxy-init -v 100:00
In order to make Ganga aware of the post_ap package do:
import sys
import os
home_dir = os.environ['HOME']
sys.path.append(f'{home_dir}/.local/lib/python3.12/site-packages')
sys.path.append('/cvmfs/lhcb.cern.ch/lib/var/lib/LbEnv/3386/stable/linux-64/lib/python3.12/site-packages')
in .ganga.py, where the path will depend on the version of python used by the LHCb environment.
To check that this is working, open ganga and run:
from post_ap.pfn_reader import PFNReader
Submitting jobs
For this one would run a line like:
job_filter_ganga -n job_name -p PRODUCTION -s SAMPLE -c /path/to/config/file.yaml -b BACKEND -v VERSION_OF_ENV
- The number of jobs will be equal to the number of PFNs, up to 500 jobs.
- The code used to filter reside in the grid and the only thing the user has to do is to provide the latest version
Check latest version of virtual environment
The jobs below will run with code from a virtual environment that is already in the grid. One should use the latest version of this environment. To know the latest versions, run:
# In a separate terminal open a shell with access to dirac
post_shell
# Run this command for a list of environmets
list_venvs
The post_shell terminal won't be used to send jobs.
Config file
Here is where all the configuration goes and an example of a config can be found here
Optional
- In order to improve the ganga experience use:
# Minimizes messages when opening ganga
# Does not start monitoring of jobs by default
alias ganga='ganga --quiet --no-mon'
in the $HOME/.bashrc file. Monitoring can be turned on by hand as explained here
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file post_ap-0.2.4.tar.gz.
File metadata
- Download URL: post_ap-0.2.4.tar.gz
- Upload date:
- Size: 35.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c25fa5e175dc809110ceed44aaa13afccf925c109a17ea110fa6968e4de7c5d8
|
|
| MD5 |
b0abe71aac01526aaa791aed14d8dd1e
|
|
| BLAKE2b-256 |
785db81907ae5d519a2c9f53f158cb4317e6d9483fcdc4712133f4fdb35078b8
|
Provenance
The following attestation bundles were made for post_ap-0.2.4.tar.gz:
Publisher:
publish.yaml on acampove/post_ap
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
post_ap-0.2.4.tar.gz -
Subject digest:
c25fa5e175dc809110ceed44aaa13afccf925c109a17ea110fa6968e4de7c5d8 - Sigstore transparency entry: 155163675
- Sigstore integration time:
-
Permalink:
acampove/post_ap@7bc6e7d8b5dbc0e35ecdacb3f0685165ebbc94db -
Branch / Tag:
refs/tags/0.2.4 - Owner: https://github.com/acampove
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yaml@7bc6e7d8b5dbc0e35ecdacb3f0685165ebbc94db -
Trigger Event:
push
-
Statement type:
File details
Details for the file post_ap-0.2.4-py3-none-any.whl.
File metadata
- Download URL: post_ap-0.2.4-py3-none-any.whl
- Upload date:
- Size: 45.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2cba1ff9ca42bb8eb073a437709c708a5081b1b5ba7b502c21e6968c738eaf6d
|
|
| MD5 |
0f376f8904378efe370008fd55f6da1a
|
|
| BLAKE2b-256 |
8b297f9698a76eaf2e7aac73f8e517c22602357898df3f36347c2fb7e0cf4c87
|
Provenance
The following attestation bundles were made for post_ap-0.2.4-py3-none-any.whl:
Publisher:
publish.yaml on acampove/post_ap
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
post_ap-0.2.4-py3-none-any.whl -
Subject digest:
2cba1ff9ca42bb8eb073a437709c708a5081b1b5ba7b502c21e6968c738eaf6d - Sigstore transparency entry: 155163676
- Sigstore integration time:
-
Permalink:
acampove/post_ap@7bc6e7d8b5dbc0e35ecdacb3f0685165ebbc94db -
Branch / Tag:
refs/tags/0.2.4 - Owner: https://github.com/acampove
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
publish.yaml@7bc6e7d8b5dbc0e35ecdacb3f0685165ebbc94db -
Trigger Event:
push
-
Statement type: