Skip to main content

Library for easier access and research of wildlife re-identification datasets

Project description

WildlifeDatasets/wildlife-datasets CI WildlifeDatasets Downloads GitHub contributors GitHub stars License

WildlifeDatasets

Pipeline for wildlife re-identification including dataset zoo, training tools and trained models. Usage includes classifying new images in labelled databases and clustering individuals in unlabelled databases.

Documentation · Report Bug · Request Feature · :mailbox_with_mail:Email

WildlifeReID-10k MegaDescriptor Wildlife tools
Dataset for identification of individual animals Trained model for individual re‑identification Tools for training re‑identification models

Wildlife Re-Identification (Re-ID) Datasets

The aim of the project is to provide a comprehensive overview of datasets for wildlife individual re-identification and an easy-to-use package for developers of machine learning methods. The core functionality includes:

  • overview of 61 publicly available wildlife re-identification datasets and 3 metadatasets.
  • utilities to mass download and convert them into a unified format and fix some wrong labels.
  • used in synergy with WildlifeTools to train our models MegaDescriptor and WildFusion.

An introductory example is provided in a Jupyter notebook. The package provides a natural synergy with WildlifeTools, which provides our MegaDescriptor model and tools for training neural networks.

Do you know about any animal re-identification dataset which is not included? Post it to the discussion forum please.

Changelog

[14/07/2026] Added BrownBearHeads (bears), CHIRP (birds), HulaPaintedFrogs (frogs), LeopardID102 (leopards), Melops (fish), RedBeeReID (bees), RotwildID_Faces (deer) and SpottedHyenaID109, SpottedHyenaID415 (hyenas).
[30/01/2026] Added AnimalCLEF2026 (unifications of multiple datasets), BalearicLizards (lizards) and TurtlesOfSMSRC (sea turtles).
[18/08/2025] Reached 50 datasets by adding BristolGorillas2020 (primates), CattleMuzzle, CoBRAReIdentificationYoungstock, HolsteinCattleRecognition (cows), CzechLynx (lynxes) and WildRaptorID (eagles).
[14/04/2025] Added AnimalCLEF2025, WildlifeReID-10k (unifications of multiple datasets), MultiCamCows2024 (cows) and PrimFace (primates).
[31/10/2024] Added AmvrakikosTurtles, ReunionTurtles, SouthernProvinceTurtles, ZakynthosTurtles (sea turtles), ELPephants (elephants) and Chicks4FreeID (chickens).
[09/05/2024] Added CatIndividualImages (cats), CowDataset (cows) and DogFaceNet (dogs).
[28/02/2024] Added MPDD (dogs), PolarBearVidID (polar bears) and SeaStarReID2023 (sea stars).
[04/01/2024] Received Best paper award at WACV 2024.

Summary of datasets

An overview of the provided datasets is available in the documentation. We include basic characteristics such as publication years, number of images, number of individuals, dataset time spans (difference between the last and first image taken) and additional information such as source, number of poses, inclusion of timestamps, whether the animals were captured in the wild and whether the dataset contains multiple species.

MetaDatasets

Dataset summary

Datasets

Dataset summary

Installation

The installation of the package is simple by

pip install wildlife-datasets

Adding new datasets

WildlifeDatasets are meant as a community effort to provide an easy access to wildlife re-identification datasets. New datasets may be easily added as described in the documentation.

Basic functionality

We show an example of downloading, extracting and processing the MacaqueFaces dataset.

from wildlife_datasets import analysis, datasets

datasets.MacaqueFaces.get_data('data/MacaqueFaces')
dataset = datasets.MacaqueFaces('data/MacaqueFaces')

The class dataset contains the summary of the dataset. The content depends on the dataset. Each dataset contains the identity and paths to images. This particular dataset also contains information about the date taken and contrast. Other datasets store information about bounding boxes, segmentation masks, position from which the image was taken, keypoints or various other information such as age or gender.

dataset.df
Overview of the MacaqueFaces dataset

The dataset also contains basic metadata including information about the number of individuals, time span, licences or published year.

dataset.summary
Metadata of the MacaqueFaces dataset

This particular dataset already contains cropped images of faces. Other datasets may contain uncropped images with bounding boxes or even segmentation masks.

dataset.plot_grid()

Additional functionality

For additional functionality including mass loading, datasets splitting or evaluation metrics we refer to the documentation or the notebooks.

Additional datasets

For a list of additional datasets not included in WidlifeDatasets, see this webpage.

License

This project is freely available under the GNU Affero General Public License v3.0 (AGPL-3.0) for research, personal, and other AGPL-compliant use. For companies or individuals who want to use it without complying with the AGPL's obligations (e.g. inside a proprietary product or service), we may offer a separate commercial license by contacting wilddatasets@gmail.com.

This license covers the code in this repository only. It does not supersede the individual licenses of the datasets it can load or reference. If you use any dataset, you must separately comply with that dataset's own license and terms of use.

If you use our package, please cite the paper.

@InProceedings{Cermak_2024_WACV,
    author    = {\v{C}erm\'ak, Vojt\v{e}ch and Picek, Luk\'a\v{s} and Adam, Luk\'a\v{s} and Papafitsoros, Kostas},
    title     = {{WildlifeDatasets: An Open-Source Toolkit for Animal Re-Identification}},
    booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
    month     = {January},
    year      = {2024},
    pages     = {5953-5963}
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wildlife_datasets-1.0.9.tar.gz (102.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wildlife_datasets-1.0.9-py3-none-any.whl (148.1 kB view details)

Uploaded Python 3

File details

Details for the file wildlife_datasets-1.0.9.tar.gz.

File metadata

  • Download URL: wildlife_datasets-1.0.9.tar.gz
  • Upload date:
  • Size: 102.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.14

File hashes

Hashes for wildlife_datasets-1.0.9.tar.gz
Algorithm Hash digest
SHA256 4d59dcf1c6f289cb4c773802b817111df286af4acdb103e7baf9666c1ea13bc4
MD5 5f57b8b5762401d51686756a4862c2c8
BLAKE2b-256 2f1d99115c9bb03611ed405776b2af3833bca8774f3c4aeed0e72e90f1583672

See more details on using hashes here.

File details

Details for the file wildlife_datasets-1.0.9-py3-none-any.whl.

File metadata

File hashes

Hashes for wildlife_datasets-1.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 8f2af4eb06f44847814b1eda3903b5b956e938c3ddab5108e55e4d4d84740c68
MD5 5b9873e76e397751c7694450bfbf62bd
BLAKE2b-256 d9c5ab0486fa8094339b3b67f1743c63f4a1e4542a04f6651fed1d25aa795842

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page