Library for easier access and research of wildlife re-identification datasets
Project description
Pipeline for wildlife re-identification including dataset zoo, training tools and trained models. Usage includes classifying new images in labelled databases and clustering individuals in unlabelled databases.
Documentation · Report Bug · Request Feature · :mailbox_with_mail:Email| Dataset for identification of individual animals | Trained model for individual re‑identification | Tools for training re‑identification models |
Wildlife Re-Identification (Re-ID) Datasets
The aim of the project is to provide a comprehensive overview of datasets for wildlife individual re-identification and an easy-to-use package for developers of machine learning methods. The core functionality includes:
- overview of 50 publicly available wildlife re-identification datasets and 2 metadatasets.
- utilities to mass download and convert them into a unified format and fix some wrong labels.
- used for training our models MegaDescriptor and WildFusion.
- synergy with WildlifeTools used for training ML models.
An introductory example is provided in a Jupyter notebook. The package provides a natural synergy with WildlifeTools, which provides our MegaDescriptor model and tools for training neural networks.
Do you know about any animal re-identification dataset which is not included? Post it to the discussion forum please.
Changelog
[18/08/2025] Reached 50 datasets by adding BristolGorillas2020 (primates), CattleMuzzle, CoBRAReIdentificationYoungstock, HolsteinCattleRecognition (cows), CzechLynx (lynxes) and WildRaptorID (eagles).
[14/04/2025] Added AnimalCLEF2025, WildlifeReID-10k (unifications of multiple datasets), MultiCamCows2024 (cows) and PrimFace (primates).
[31/10/2024] Added AmvrakikosTurtles, ReunionTurtles, SouthernProvinceTurtles, ZakynthosTurtles (sea turtles), ELPephants (elephants) and Chicks4FreeID (chickens).
[09/05/2024] Added CatIndividualImages (cats), CowDataset (cows) and DogFaceNet (dogs).
[28/02/2024] Added MPDD (dogs), PolarBearVidID (polar bears) and SeaStarReID2023 (sea stars).
[04/01/2024] Received Best paper award at WACV 2024.
Summary of datasets
An overview of the provided datasets is available in the documentation. We include basic characteristics such as publication years, number of images, number of individuals, dataset time spans (difference between the last and first image taken) and additional information such as source, number of poses, inclusion of timestamps, whether the animals were captured in the wild and whether the dataset contains multiple species.
MetaDatasets
Datasets
Installation
The installation of the package is simple by
pip install wildlife-datasets
Adding new datasets
WildlifeDatasets are meant as a community effort to provide an easy access to wildlife re-identification datasets. New datasets may be easily added as described in the documentation.
Basic functionality
We show an example of downloading, extracting and processing the MacaqueFaces dataset.
from wildlife_datasets import analysis, datasets
datasets.MacaqueFaces.get_data('data/MacaqueFaces')
dataset = datasets.MacaqueFaces('data/MacaqueFaces')
The class dataset contains the summary of the dataset. The content depends on the dataset. Each dataset contains the identity and paths to images. This particular dataset also contains information about the date taken and contrast. Other datasets store information about bounding boxes, segmentation masks, position from which the image was taken, keypoints or various other information such as age or gender.
dataset.df
The dataset also contains basic metadata including information about the number of individuals, time span, licences or published year.
dataset.summary
This particular dataset already contains cropped images of faces. Other datasets may contain uncropped images with bounding boxes or even segmentation masks.
dataset.plot_grid()
Additional functionality
For additional functionality including mass loading, datasets splitting or evaluation metrics we refer to the documentation or the notebooks.
Additional datasets
For a list of additional datasets not included in WidlifeDatasets, see this webpage.
Citation
If you like our package, please cite our paper. You may be also interested in our SeaTurtleID2022 dataset published in another paper.
@InProceedings{Cermak_2024_WACV,
author = {\v{C}erm\'ak, Vojt\v{e}ch and Picek, Luk\'a\v{s} and Adam, Luk\'a\v{s} and Papafitsoros, Kostas},
title = {{WildlifeDatasets: An Open-Source Toolkit for Animal Re-Identification}},
booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
month = {January},
year = {2024},
pages = {5953-5963}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file wildlife_datasets-1.0.8.tar.gz.
File metadata
- Download URL: wildlife_datasets-1.0.8.tar.gz
- Upload date:
- Size: 70.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4652ac4563fd805ff0770dfc4409689d5eb8df6ab5acda99bf0b98ed854e3019
|
|
| MD5 |
d1f7a14ced348df93172329e68b289f0
|
|
| BLAKE2b-256 |
304f83a5b9f493188338ebd69a610612a1e268635697a4316fd681ef08387c65
|
File details
Details for the file wildlife_datasets-1.0.8-py3-none-any.whl.
File metadata
- Download URL: wildlife_datasets-1.0.8-py3-none-any.whl
- Upload date:
- Size: 108.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.11
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a399e233434a0ae2c1c2aeb6bc9cc62625b7786f391dfca9ee481511aae3ce03
|
|
| MD5 |
2a00ef66e5af9777a14c7ce8fada2379
|
|
| BLAKE2b-256 |
7acbfc5f2e55cdcaa832c186ceb8c91cae8bef389f7bea06a29553095d34f756
|