Official implementation of STREAMER, a self-supervised hierarchical event segmentation and representation learning
Project description
STREAMER
The official PyTorch implementation of our NeurIPS'23 paper STREAMER: Streaming Representation Learning and Event Segmentation in a Hierarchical Manner
Overview
Documentation
Checkout the documentation of STREAMER modules to learn more details about how to use our codebase.
Installation
pip install streamer-torch # with pip from PyPI
pip install git+'https://github.com/ramyamounir/streamer-torch' # with GitHub
Inference
Note: Pretrained weights are coming soon..
from streamer.models.inference_model import InferenceModel
model = InferenceModel(checkpoint='to/checkpoint/path/')
result = model(filename='to/video/file/path')
Training
In order to perform training with streamer:
- Use the Dataset README.md to preprocess datasets for streaming loading and evaluation.
- Use the provided training script to train on multiple gpus (i.e., or multi-node).
- The script compare.py can be used to evaluate the model's prediction using Hierarchical Level Reduction.
Bash scripts with CLI arguments are provided in helper_scripts
Citing STREAMER
If you find our approaches useful in your research, please consider citing:
@inproceedings{mounir2023streamer,
title={STREAMER: Streaming Representation Learning and Event Segmentation in a Hierarchical Manner},
author={Mounir, Ramy and Vijayaraghavan, Sujal and Sarkar, Sudeep},
booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
year={2023}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
streamer-torch-0.0.2.tar.gz
(27.1 kB
view hashes)
Built Distribution
Close
Hashes for streamer_torch-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 11bb9c2c8807245bbfeb907470180146187029d676564ae3435acff608b51c33 |
|
MD5 | d90113dbd9857c93b3a4533ea75018b9 |
|
BLAKE2b-256 | ef69116bc6cdfc8c5567aa853a2c949ff9549f3c22b2ef4c2c1214ca5a7db7c6 |