generalizit 0.0.2

Generalizability theory fully crossed and nested

GeneralizIT: Generalizability Theory Analysis in Python

Overview

GeneralizIT is a Python-based library designed for conducting Generalizability Theory (GT) analyses. The library supports multiple research designs and provides tools to calculate ANOVA tables, generalizability coefficients (G coefficients), and decision (D) studies.

It is particularly useful for researchers and practitioners who work with multi-faceted designs and want to quantify the reliability and generalizability of their measurements.

Features

• Support for Various Designs: Handles different research designs (e.g., crossed, nested).
• Automated Data Cleaning: Prepares your data by dropping unnecessary columns and normalizing names.
• ANOVA Calculation: Produces ANOVA tables specific to your design.
• G Coefficients: Computes generalizability coefficients to assess reliability.
• D Studies: Performs decision studies with customizable levels for facets.
• Summaries: Provides concise summaries for ANOVA, G coefficients, and D studies.

Installation

To use this library, the following dependencies are installed alongside the package:

• pandas
• numpy
• scipy

Usage

Initializing GeneralizIT

from generalizit import GeneralizIT

# Initialize with:
# - `data`: A pandas DataFrame containing your data.
# - `input_str`: A string describing the research design (e.g., "Person x i x o").
# - `response`: The column name for the response variable.
GT = GeneralizIT(data=formatted_df, input_str='Person x i x o', response='Response')

Example Workflow

1. Calculate ANOVA

   GT.calculate_anova()
   

2. Compute G Coefficients

   GT.g_coeffs()
   

3. Perform a D Study

   GT.calculate_d_study(levels={'Person': None, 'i': [4, 8], 'o': [1, 2]})
   

4. Calculate Confidence Intervals

   GT.calculate_confidence_intervals(alpha=0.05)
   

5. View Summaries
   • ANOVA Summary:

     GT.anova_summary()
     

   • G Coefficients Summary:

     GT.g_coeff_summary()
     

   • D Study Summary:

     GT.d_study_summary()
     

   • Confidence Intervals Summary:

       GT.confidence_intervals_summary()
     

Input Data Format

The input data must be a pandas DataFrame where each column represents a facet, and one column is the response variable.

 | Person | i | o | Response |
 |--------|---|---|----------|
 |      1 | 1 | 1 |        2 |
 |      1 | 2 | 1 |        6 |
 |      1 | 3 | 1 |        7 |
 |      1 | 4 | 1 |        5 |
 |      1 | 1 | 2 |        2 |
 |      1 | 2 | 2 |        5 |
 |      1 | 3 | 2 |        5 |
 |      1 | 4 | 2 |        5 |
 ...
 |     10 | 1 | 1 |        6 |
 |     10 | 2 | 1 |        8 |
 |     10 | 3 | 1 |        7 |
 |     10 | 4 | 1 |        6 |
 |     10 | 1 | 2 |        6 |
 |     10 | 2 | 2 |        8 |
 |     10 | 3 | 2 |        8 |
 |     10 | 4 | 2 |        6 |

Conversely, if the design was nested such as person x (rater:item), raters are nested under item and should be identified uniquely either by delineation item1_rater1 or unique numbering as below:

| Person | item | rater | Response |
|--------|------|-------|----------|
|      1 |    1 |     1 |        2 |
|      1 |    1 |     2 |        6 |
|      1 |    1 |     3 |        7 |
|      1 |    1 |     4 |        5 |
|      1 |    2 |     5 |        2 |
|      1 |    2 |     6 |        5 |
|      1 |    2 |     7 |        5 |
|      1 |    2 |     8 |        5 |
|      1 |    3 |     9 |        6 |
|      1 |    3 |    10 |        8 |
|      1 |    3 |    11 |        7 |
|      1 |    3 |    12 |        6 |
|      2 |    1 |     1 |        6 |
|      2 |    1 |     2 |        8 |
|      2 |    1 |     3 |        8 |
|      2 |    1 |     4 |        6 |
...

Example Datasets

Synthetic Data from Brennan (2001)

The package includes examples of synthetic data used to demonstrate the functionality of the library. You can adapt these examples to your own datasets.

Research Design Syntax

The input_str parameter specifies the research design. Supported formats include:

• Crossed Designs: "Person x i x o"
• Nested Designs: "Person x (r:t)"

Output

• ANOVA Table: Provides variance component estimates for each facet.
• G Coefficients: Estimates the reliability of measurements across facets.
• D Studies: Offers predictions of generalizability for specified facet levels.

Notes

• Ensure your data is preprocessed to include only the necessary facets and the response variable.
• Column names should match those specified in the research design.
• Use the _clean_data method to automate column renaming and pruning.

License

This library is licensed under the MIT License.

Contributions

Contributions to improve functionality or expand supported designs are welcome! Please fork the repository and create a pull request.

Contact

For questions or support, raise an issue in the github repo!

---

Happy analyzing with GeneralizIT!