medvqa 0.15.5

Competition Submission CLI for ImageCLEFmed-MedVQA-GI-2025 (https://github.com/simula/ImageCLEFmed-MEDVQA-GI-2025)

---

sdk: gradio sdk_version: 5.41.1 app_file: gradio_launcher.py

MedVQA

A CLI tool used for multiple MedVQA competitions: ImageCLEFmed-MEDVQA-GI-2025, ImageCLEFmed-MEDVQA-GI-2026, MediaEval-Medico-2025, and MediaEval-Medico-2026.

Installation

pip install -U medvqa

The library is under heavy development. So, we recommend to always make sure you have the latest version installed.

For development:

pip install git+https://github.com/SushantGautam/MedVQA.git

Also has full_evaluate and challenge_evaluate modules for detailed evaluation for the competition organizers.

Example Usage

Check respective competition repo for detailed submission instructions. For example: MediaEval-Medico-2025 competition repo.

medvqa validate_and_submit --competition=medico-2025 --task=1 --repo_id=...
# or for Medico 2026:
medvqa validate_and_submit --competition=medico-2026 --task=1 --repo_id=...
# or for MEDVQA-GI 2026:
medvqa validate_and_submit --competition=gi-2026 --task=1 --repo_id=...

where repo_id is your HuggingFace Model repo id (like SushantGautam/XXModelCheckpoint) with the submission script as required by the competition organizers, for eg, submission_task1.py file for task 1 and submission_task2.py for task 2.