OpenSportsLib is the professional library, designed for advanced video understanding in sports. It provides state-of-the-art tools for action recognition, spotting, retrieval, and captioning, making it ideal for researchers, analysts, and developers working with sports video data.
Project description
OpenSportsLib
OpenSportsLib is a modular Python library for sports video understanding.
It provides a unified framework to train, evaluate, and run inference for key temporal understanding tasks in sports video, including:
- Action classification
- Action localization / spotting
- Action retrieval
- Action description / captioning
OpenSportsLib is designed for researchers, ML engineers, and sports analytics teams who want reproducible and extensible workflows for sports video AI.
Why OpenSportsLib?
- Unified workflow for training and inference
- Modular design for adding new tasks, datasets, and models
- Config driven experiments for reproducibility
- Support for multiple modalities and sports workflows
- Research friendly while still usable in applied settings
Quick links
- Documentation: https://opensportslab.github.io/opensportslib/
- OSL JSON format: https://opensportslab.github.io/opensportslib/data/osl-json-format/
- PyPI: https://pypi.org/project/opensportslib/
- Issues: https://github.com/OpenSportsLab/opensportslib/issues
Installation
Requires Python 3.12+.
Supports CUDA 12.6 / 12.8 / 13.0 (with CPU fallback).
PyTorch Geometric is supported up to PyTorch 2.10.*.
Stable release
pip install opensportslib
Pre release
pip install --pre opensportslib
Setup Environment (PyTorch, CUDA aware & Optional Dependencies)
# Install PyTorch (CPU/GPU auto-detected)
opensportslib setup
# Optional: install PyTorch Geometric support
opensportslib setup --pyg
# Optional: install for DALI support
opensportslib setup --dali
Note:
Run opensportslib setup to automatically configure dependencies.
If issues occur, manually install compatible versions of torch, torchvision, and related libraries according to your CUDA version or system compatibility.
Data and pretrained models
OpenSportsLib uses external annotation files, datasets, and pretrained checkpoints.
Public assets are hosted under the OpenSportsLab Hugging Face organization:
https://huggingface.co/OpenSportsLab
Use it as the main entry point to find:
- datasets
- annotation files
- extracted features
- pretrained models and checkpoints
See the Model Zoo for available pretrained models, reported scores, datasets, and loading snippets.
Dataset format
OpenSportsLib annotation files use the OSL JSON v2.0 format. A dataset JSON
contains top-level metadata, a shared labels schema, and a data array where
each sample points to one or more inputs.
Minimal classification sample:
{
"labels": {
"action": {
"type": "single_label",
"labels": ["pass", "shot"]
}
},
"data": [
{
"id": "clip_0001",
"inputs": [
{
"type": "video",
"path": "clips/clip_0001.mp4",
"fps": 25.0
}
],
"labels": {
"action": {
"label": "shot"
}
}
}
]
}
Minimal localization sample:
{
"labels": {
"action": {
"type": "single_label",
"labels": ["pass", "shot"]
}
},
"data": [
{
"id": "game_0001",
"inputs": [
{
"type": "video",
"path": "games/game_0001.mp4",
"fps": 25.0
}
],
"events": [
{
"head": "action",
"label": "pass",
"position_ms": 1240
}
]
}
]
}
Relative paths in inputs[].path are resolved from the split media root in the
YAML config, for example DATA.train.video_path. See the full
OSL JSON format guide for field definitions,
multi-modal examples, prediction payloads, and conversion notes.
Quickstart
Import the library
import opensportslib
print("OpenSportsLib imported successfully")
Train a classification model
from opensportslib.apis import ClassificationModel
my_model = ClassificationModel(
config="/path/to/classification.yaml",
weights=None, # optional: path or Hugging Face model ID
)
my_model.train(
train_set="/path/to/train_annotations.json",
valid_set="/path/to/valid_annotations.json",
)
Run inference
from opensportslib.apis import ClassificationModel
my_model = ClassificationModel(
config="/path/to/classification.yaml",
weights=None, # optional: path or Hugging Face model ID
)
predictions = my_model.infer(
test_set="/path/to/test_annotations.json",
)
saved_predictions = my_model.save_predictions(
output_path="/path/to/predictions.json",
predictions=predictions,
)
metrics = my_model.evaluate(
test_set="/path/to/test_annotations.json",
)
metrics_from_file = my_model.evaluate(
test_set="/path/to/test_annotations.json",
predictions=saved_predictions,
)
print(metrics)
Localization example
from opensportslib.apis import LocalizationModel
my_model = LocalizationModel(
config="/path/to/localization.yaml",
weights=None, # optional: path or Hugging Face model ID
)
predictions = my_model.infer(
test_set="/path/to/test_annotations.json",
)
saved_predictions = my_model.save_predictions(
output_path="/path/to/predictions.json",
predictions=predictions,
)
metrics = my_model.evaluate(
test_set="/path/to/test_annotations.json",
)
metrics_from_file = my_model.evaluate(
test_set="/path/to/test_annotations.json",
predictions=saved_predictions,
)
Hugging Face Dataset Transfer
OpenSportsLib provides APIs and scripts for downloading and uploading OSL datasets with Hugging Face.
Python API
from opensportslib.tools import (
download_dataset_split_from_hf,
upload_dataset_inputs_from_json_to_hf,
upload_dataset_as_parquet_to_hf,
)
Scripts
python tools/download/download_osl_hf.py --repo-id <org/repo> --revision main --split test --format parquet --output-dir downloaded_data
python tools/download/upload_osl_hf.py --repo-id <org/repo> --json-path <local_dataset.json> --split test --revision main
Downloads are placed under <output-dir>/<revision>/<split>.
What you can do with OpenSportsLib
Action Classification
Classify clips or event centered samples into predefined categories.
Action Localization / Spotting
Predict when key events happen in long untrimmed sports videos.
Action Retrieval
Search and retrieve relevant clips or moments from a collection of sports videos. This is part of the roadmap and OSL data model, not a first-class OpenSportsLib training workflow yet.
Action Description / Captioning
Generate text descriptions for sports events and temporal segments. This is part of the roadmap and OSL data model, not a first-class OpenSportsLib training workflow yet.
Typical workflow
- Prepare your dataset in the expected format
- Select or create a YAML config
- Initialize the task specific model
- Train on your annotations
- Run inference on new data
- Extend the pipeline with your own datasets or models
Examples and documentation
Use the README for the fast start, then go deeper through:
- Full documentation: https://opensportslab.github.io/opensportslib/
- OSL JSON format: docs/data/osl-json-format.md
- High-level API guide: opensportslib/apis/README.md
- Configuration guide: https://opensportslab.github.io/opensportslib/tni/config-guide/
- Example configs: examples/configs/
- Quickstart scripts: examples/quickstart/
- Contribution guide: CONTRIBUTING.md
- Developer guide: DEVELOPERS.md
Development setup
For contributors who want to work from source:
git clone https://github.com/OpenSportsLab/opensportslib.git
cd opensportslib
pip install -e .
Conda option
If you prefer conda:
conda create -n osl python=3.12 pip
conda activate osl
pip install -e .
Setup Environment (PyTorch, CUDA aware & Optional Dependencies)
# Install PyTorch (CPU/GPU auto-detected)
opensportslib setup
# Optional: install PyTorch Geometric support
opensportslib setup --pyg
# Optional: install for DALI support
opensportslib setup --dali
Git workflow
- Make sure you are branching from
dev - Create your feature or fix branch from
dev - Open a pull request back into
dev
Contributing
We welcome contributions to OpenSportsLib.
Please check:
These documents describe:
- how to add models and datasets
- coding standards
- training pipeline structure
- how to run and test the framework
License
OpenSportsLib is available under dual licensing.
Open source license
AGPL 3.0 for research, academic, and community use.
Commercial license
For proprietary or commercial deployment, please refer to LICENSE-COMMERCIAL.
Citation
If you use OpenSportsLib in your research, please cite the project.
@misc{opensportslib,
title={OpenSportsLib},
author={OpenSportsLab},
year={2026},
howpublished={\url{https://github.com/OpenSportsLab/opensportslib}}
}
Acknowledgments
OpenSportsLib is developed within the broader OpenSportsLab effort for sports video understanding.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file opensportslib-0.1.3.dev3.tar.gz.
File metadata
- Download URL: opensportslib-0.1.3.dev3.tar.gz
- Upload date:
- Size: 203.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f9cdb3f49dad3064017bcfe58714885c50e6392174b65ebd743cff721883c015
|
|
| MD5 |
202220b6a1a7d365d60d1e1b7996e475
|
|
| BLAKE2b-256 |
1f2f49279ddcaf9f10ab4fb2ec306a3a1dd53b2d5ffe7a0a7aa9620a761f4a2d
|
File details
Details for the file opensportslib-0.1.3.dev3-py3-none-any.whl.
File metadata
- Download URL: opensportslib-0.1.3.dev3-py3-none-any.whl
- Upload date:
- Size: 246.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.13
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9f346be515366f7c19c4e494489b5482ecede1bcb09d8ef44101876a7e50c8d4
|
|
| MD5 |
246aa0ccebbf0a37f191ebeef796dee7
|
|
| BLAKE2b-256 |
78df8081fc842aab00d6abf5c5c249898cded971fd2878fd836d3a5d9e00d30b
|