Skip to main content

A CLI tool for generating high-quality image-text pairs for AI training

Project description

GenIText: Generative Image-Text Automated package

Demonstration video of GenIText tool

Overview

This repository is independently developed as a felxible framework to generate high-quality Image-Text pairs for finetuning Image-Generation models, such as Stable Diffusion, DALL-E, and other generative models. By leveraging open-source captioning models, GenIText automates the process of generating diverse captions for corresponding images, ensuring that the text data is well-suited for downstream applications such as style-specific generations or domain adaptation. This framework is designed to complement contemporary repositories or modules in the field, offering an additional option for flexibility and automation to create customized datasets.

GenIText will become distributable as a CLI tool once package is ready for testing across systems. Please support in any way you see fit!

Table of Contents

Benchmarks

Model Auto-Batch Memory Usage Auto-Batch Seconds per Image 1 Batch Memory Usage 1 Batch Seconds per Image
LLaVA 7B 17,978 MB 3.25 7,014 MB 3.62
ViT-GPT2 0.27B 7,570 MB 0.08 914 MB 0.79
BLIPv2 2.7B 13,534 MB 0.25 4,590 MB 2.53

All models were tested on 502 random image from kaggle dataset found here. Images were resized based on their config files and tested on GeForce RTX 4090 Graphics Card with 24 Gb memory.

Installation

GenIText is available as a Python package and can be installed easily using pip.

To install GenIText, simply run:

pip install genitext

After installation, you can verify that the CLI tool is accessible by running:

genitext --help

To initiate the CLI tool, run:

genitext

GenIText incorporates LLMs from Ollama to assist with prompt refinement which means ollama has to be available on the device when running /refine in the CLI tool. You can download the software for Mac or Windows OS from here. For Linux OS, you can install directly via the following:

curl -fsSL https://ollama.com/install.sh | sh

After installing, pull the appropriate LLM you want to use in /refine. Currently, the default config is set to deepseek-r1:7b since it offers strong performance with it's reasoning capabilities while using relatively trivial memory. Options to switch the LLM in config will be made available soon.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

genitext-0.3.3.tar.gz (204.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

genitext-0.3.3-py3-none-any.whl (30.5 kB view details)

Uploaded Python 3

File details

Details for the file genitext-0.3.3.tar.gz.

File metadata

  • Download URL: genitext-0.3.3.tar.gz
  • Upload date:
  • Size: 204.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.0

File hashes

Hashes for genitext-0.3.3.tar.gz
Algorithm Hash digest
SHA256 b0bf50322e3a5a81cd8adcd7b8ef9b375bc041dc48033259208352b4637268ba
MD5 3c517ffced108a6e829132e148c5b9b0
BLAKE2b-256 e0317c98e11670bfa363bf5d86087b90035cc10c616dfc864e3f0c5a8fe56470

See more details on using hashes here.

File details

Details for the file genitext-0.3.3-py3-none-any.whl.

File metadata

  • Download URL: genitext-0.3.3-py3-none-any.whl
  • Upload date:
  • Size: 30.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.0

File hashes

Hashes for genitext-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 b4c01154f836689c5bd20448fc8d3cbcddc6586dec685cb27ea6e9fa79d79eae
MD5 8ffc4fc3306107f322afa17bb29efc48
BLAKE2b-256 7b424565ab10d1a1bbeb5a77e5442baa47c4f0f4ee989550bcd9bc18d7636032

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page