Projection Games Framework

PROGAF (Projection Games Framework) is python framework to support development of games and other applications using projection mapping (also known as surface projection, video mapping or spatial augmented reality) and/or real world object tracking using cameras. Expected uses for the framework include the development of games and possibly other applications across several domains including education, training, marketing, exhibition, entertainment and art.

The goal of the project is to provide a light, conceptually clean, open source framework to support application development. Main features are:

• Object-oriented abstraction layer including:
  • Hardware Integration (standard camera, depth camera, projector)
  • Object detection, identification and tracking (with specific detectors for faces, eyes, hands, geometric shapes and blobs) using OpenCV and Google MediaPipe
  • Gestures and events detection and processing
  • Easy integration of detected objects into other frameworks / game engines:
    • PyGame
    • Panda3D

The framework also supports projection-mapping applications with specific features:

• Easy and intuitive projector-camera alignment and calibration
• Affine and pespective transformations of application objects
• Projection mapping over static surfaces and/or moving objects in real time
• Capabilities to render/project in real time any combination of video streams, images, textures, text or graphics