NeuroVC

Toolbox with utility functions for computer vision setups in neuroscience. The core module contains classes for motion magnification and camera io.

Citation

If you use this code in work for publications, please cite in the following way.

1. Camera routines:

Flotho, P., Bhamborae, M., Grun, T., Trenado, C., Thinnes, D., Limbach, D., & Strauss, D. J. (2021). Multimodal Data Acquisition at SARS-CoV-2 Drive Through Screening Centers: Setup Description and Experiences in Saarland, Germany. J Biophotonics.

BibTeX entry

@article{flotea2021b,
    author = {Flotho, P. and Bhamborae, M.J. and Grün, T. and Trenado, C. and Thinnes, D. and Limbach, D. and Strauss, D. J.},
    title = {Multimodal Data Acquisition at SARS-CoV-2 Drive Through Screening Centers: Setup Description and Experiences in Saarland, Germany},
    year = {2021},
  journal = {J Biophotonics},
  pages = {e202000512},
  doi = {https://doi.org/10.1002/jbio.202000512}
}

2. Motion magnification:

Flotho, P., Heiss, C., Steidl, G., & Strauss, D. J. (2023). Lagrangian motion magnification with double sparse optical flow decomposition. Frontiers in Applied Mathematics and Statistics, 9, 1164491.

@article{flotho2023lagrangian,
  title={Lagrangian motion magnification with double sparse optical flow decomposition},
  author={Flotho, Philipp and Heiss, Cosmas and Steidl, Gabriele and Strauss, Daniel J},
  journal={Frontiers in Applied Mathematics and Statistics},
  volume={9},
  pages={1164491},
  year={2023},
  publisher={Frontiers Media SA}
}

and for facial landmark-based decomposition:

Flotho, P., Heiß, C., Steidl, G., & Strauss, D. J. (2022, July). Lagrangian motion magnification with landmark-prior and sparse PCA for facial microexpressions and micromovements. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (pp. 2215-2218). IEEE.

@inproceedings{flotho2022lagrangian,
  title={Lagrangian motion magnification with landmark-prior and sparse PCA for facial microexpressions and micromovements},
  author={Flotho, Philipp and Hei{\ss}, Cosmas and Steidl, Gabriele and Strauss, Daniel J},
  booktitle={2022 44th Annual International Conference of the IEEE Engineering in Medicine \& Biology Society (EMBC)},
  pages={2215--2218},
  year={2022},
  organization={IEEE}
}

3. Thermal landmarks:

Flotho, P., Piening, M., Kukleva, A., & Steidl, G. (2024). T-FAKE: Synthesizing Thermal Images for Facial Landmarking. arXiv preprint arXiv:2408.15127.

@article{flotho2024t,
  title={T-FAKE: Synthesizing Thermal Images for Facial Landmarking},
  author={Flotho, Philipp and Piening, Moritz and Kukleva, Anna and Steidl, Gabriele},
  journal={arXiv preprint arXiv:2408.15127},
  year={2024}
}

Licensing Notice:

This project contains code derived from RAFT, which is licensed under the BSD 3-Clause License. See neurovc/raft/LICENSE for details. The rest of this project is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 1.0 license (CC BY-NC-SA 1.0). See LICENSE for details.

When using or redistributing this project, you must comply with both licenses.