Autodistill GPTo Module

This repository contains the code supporting the GPTo base model for use with Autodistill.

[GPTo](https://openai.com/index/hello-gpt-4o/, developed by OpenAI, is a multi-modal language model that works across the image, text, and audio domains. With GPTo, you can ask questions about images in natural language. The autodistill-gpt4o module enables you to classify images using GPT-4V.

This model uses the gpt-4-o API announced by OpenAI on May 13th, 2024.

Read the full Autodistill documentation.

Installation

To use GPT-4o with autodistill, you need to install the following dependency:

pip3 install autodistill-gpt-4o

Quickstart

from autodistill_gpt_4o import GPT4o

# define an ontology to map class names to our GPT-4o prompt
# the ontology dictionary has the format {caption: class}
# where caption is the prompt sent to the base model, and class is the label that will
# be saved for that caption in the generated annotations
# then, load the model
base_model = GPT4o(
    ontology=CaptionOntology(
        {
            "person": "person",
            "a forklift": "forklift"
        }
    ),
    api_key="OPENAI_API_KEY"
)
base_model.label("./context_images", extension=".jpeg")

License

This project is licensed under an MIT license.

🏆 Contributing

We love your input! Please see the core Autodistill contributing guide to get started. Thank you 🙏 to all our contributors!