Skip to main content

A package for reweighting MC samples to match data

Project description

mcreweight

mcreweight is a python library to perform Monte Carlo event reweighting based on multiplicity and kinematic variables. The tool is using GBReweighter, a classifier-based method implemented in hep_ml package, and it supports automated hyperparameter tuning with Optuna. A folding approach over the reweighter is also applied, and performances are compared with the ones from the bins reweighting.

[!WARNING] Bins reweighting works fine for one or two dimensional histograms, but it is unstable and inaccurate for higher dimenstions

Requirements

  • Python 3.8+
  • Required packages listed in pyproject.toml

Setup

Run in a lb-conda environment, as

lb-conda mcreweight

Installation

If you don't run in a lb-conda environment, consider installing the python package from PyPI or cloning it from GitLab

From PyPI

pip install mcreweight

From Gitlab

git clone https://github.com/tfulghes/mcreweight.git
cd mcreweight
pip install -e .

Usage

To run the reweighting:

run-reweight --path_data <path_to_data.root> \
    	     --path_mc <path_to_mc.root> \
    	     --vars <variable_list> \
    	     --monitoring_vars <monitoring_variable_list> \
    	     --sample <sample> \
    	     --n_trials <optuna_tests> \
    	     --test_size <test_sample_size>

To apply the weights to the signal MC:

apply-weights --path_mc <path_to_mc.root> \
    	      --vars <variable_list> \
    	      --training_sample <training_sample> \
    	      --application_sample <application_sample> \
    	      --method <method_for_reweighter> \
    	      --monitoring_vars <monitoring_variable_list> \
    	      --output_path <output_file.root>

Options

For the reweighting (run-reweight):

Input files:

  • --path_data: Path to the data control sample (required)
  • --tree_data: Name of the tree in the data control sample (default: "DecayTree")
  • --path_mc: Path to the MC control sample (required)
  • --tree_mc: Name of the tree in the MC control sample (default: "DecayTree")
  • --mcweights_name: Name of the branch for weights in the MC sample (default: None)
  • --sweights_name: Name of the sweights column in the data (default: "sweight_sig")
  • --mc_label: Label for the MC sample (default: "MC")
  • --data_label: Label for the data sample (default: "Data")

Variables:

  • --vars: List of variables to use for reweighting (default: ["B_DTF_Jpsi_P", "B_DTF_Jpsi_PT", "nLongTracks", "nPVs"])
  • --monitoring_vars: List of variables to plot (default: None)

Reweighter configuration:

  • --sample: Sample name for the dataset (default: "bd_jpsikst_ee")
  • --n_trials: Number of trials for the gradient boosting reweighting (default: 10)
  • --test_size: Proportion of the dataset to include in the test split (default: 0.3)
  • --n_folds: Number of folds for k-folding reweighting (default: 4)
  • --n_bins: Number of bins for binning reweighting (default: 20)
  • --n_neighs: Number of nearest neighbors for binning reweighting (default: 3)

Output:

  • --weightsdir: Directory to save weights (default: "weights")
  • --plotdir: Directory to save plots (default: "plots")

Additional options can be found by running:

run-reweight --help

For the application of the weights (apply-weights):

Input files:

  • --path_mc: Path to the MC signal sample (required)
  • --tree_mc: Name of the tree in the MC signal sample (default: "DecayTree")
  • --mcweights_name: Name of the branch for weights in the output ROOT file (default: None)
  • --path_data: Path to the data sample for comparison (default: None)
  • --tree_data: Name of the tree in the data sample (default: "DecayTree")
  • --sweights_name: Name of the sweights column in the data (default: "sweight_sig")

Variables:

  • --vars: List of variables to use for reweighting (default: ["B_DTF_Jpsi_P", "B_DTF_Jpsi_PT", "nLongTracks", "nPVs"])
  • --training_vars: List of variables used for training (default: ["B_DTF_Jpsi_P", "B_DTF_Jpsi_PT", "nLongTracks", "nPVs"])
  • --monitoring_vars: List of variables to plot (default: None)

Configuration:

  • --training_sample: Sample name for the dataset (default: "bd_jpsikst_ee")
  • --application_sample: Sample name for the application of weights (default: "bd_jpsikst_ee")
  • --method: Method to apply weights (choices: "gbreweighter", "kfolding", "binning", default: "gbreweighter")
  • --weightsdir: Directory to save weights (default: "weights")
  • --plotdir: Directory to save plots (default: "plots")

Output:

  • --output_path: Path to save the output ROOT file (required)
  • --output_tree: Name of the tree in the output ROOT file (default: "DecayTree")

Additional options can be found by running:

apply-weights --help

Example

Reweighting:

run-reweight --path_data data/control_sample_tuple.root \
    	     --path_mc mc/control_sample_tuple.root \
    	     --vars B_DTF_Jpsi_P B_DTF_Jpsi_PT nLongTracks nPVs \
    	     --monitoring_vars B_ETA nFTClusters nVPClusters nEcalClusters \
    	     --sample bd_jpsikst_ee \
    	     --n_trials 5 \
    	     --test_size 0.3 

Application of the weights:

apply-weights --path_mc mc/signal_tuple.root \
    	      --vars B_P B_PT nLongTracks nPVs  \
    	      --training_vars B_DTF_Jpsi_P B_DTF_Jpsi_PT nLongTracks nPVs  \
    	      --training_sample bd_jpsikst_ee \
    	      --application_sample bd_jpsikst_ee \
    	      --method gbreweighter \
    	      --monitoring_vars B_ETA nFTClusters nVPClusters nEcalClusters \
    	      --output_path mc/signal_tuple_reweighted.root

Contact

For questions, please contact the repository maintainer.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mcreweight-0.3.1.tar.gz (53.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mcreweight-0.3.1-py3-none-any.whl (42.7 kB view details)

Uploaded Python 3

File details

Details for the file mcreweight-0.3.1.tar.gz.

File metadata

  • Download URL: mcreweight-0.3.1.tar.gz
  • Upload date:
  • Size: 53.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.14

File hashes

Hashes for mcreweight-0.3.1.tar.gz
Algorithm Hash digest
SHA256 38fc0f07eb6080e63243c68ee0da6e66b16b97453fc01ed770b5e5dbec707778
MD5 1a7cee0e24bf982134ff26291b4b16ef
BLAKE2b-256 124270d01a8cce36ec9304fc63ba874295848efeaef341544047ad59ca28dad6

See more details on using hashes here.

File details

Details for the file mcreweight-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: mcreweight-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 42.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.14

File hashes

Hashes for mcreweight-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 f13048bacfb620a7a969812902e194777243ff4c7d0798e0f035de9134bcab80
MD5 2f8d5e65f27206471c7de6d6a2cd541c
BLAKE2b-256 62638804a5c07c7de36e61bdbe014ff3a186034130ac72cd7114e19557ea8f5c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page