Skip to main content

A CLI tool for generating high-quality image-text pairs for AI training

Project description

GenIText: Generative Image-Text Automated package

Demonstration video of GenIText tool

Overview

This repository is independently developed as a felxible framework to generate high-quality Image-Text pairs for finetuning Image-Generation models, such as Stable Diffusion, DALL-E, and other generative models. By leveraging open-source captioning models, GenIText automates the process of generating diverse captions for corresponding images, ensuring that the text data is well-suited for downstream applications such as style-specific generations or domain adaptation. This framework is designed to complement contemporary repositories or modules in the field, offering an additional option for flexibility and automation to create customized datasets.

GenIText will become distributable as a CLI tool once package is ready for testing across systems. Please support in any way you see fit!

Table of Contents

Benchmarks

Model Auto-Batch Memory Usage Auto-Batch Seconds per Image 1 Batch Memory Usage 1 Batch Seconds per Image
LLaVA 7B 17,978 MB 3.25 7,014 MB 3.62
ViT-GPT2 0.27B 7,570 MB 0.08 914 MB 0.79
BLIPv2 2.7B 13,534 MB 0.25 4,590 MB 2.53

All models were tested on 502 random image from kaggle dataset found here. Images were resized based on their config files and tested on GeForce RTX 4090 Graphics Card with 24 Gb memory.

Installation

GenIText is available as a Python package and can be installed easily using pip.

To install GenIText, simply run:

pip install genitext

After installation, you can verify that the CLI tool is accessible by running:

genitext --help

To initiate the CLI tool, run:

genitext

GenIText incorporates LLMs from Ollama to assist with prompt refinement which means ollama has to be available on the device when running /refine in the CLI tool. You can download the software for Mac or Windows OS from here. For Linux OS, you can install directly via the following:

curl -fsSL https://ollama.com/install.sh | sh

After installing, pull the appropriate LLM you want to use in /refine. Currently, the default config is set to deepseek-r1:7b since it offers strong performance with it's reasoning capabilities while using relatively trivial memory. Options to switch the LLM in config will be made available soon.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

genitext-0.3.2.tar.gz (204.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

genitext-0.3.2-py3-none-any.whl (30.6 kB view details)

Uploaded Python 3

File details

Details for the file genitext-0.3.2.tar.gz.

File metadata

  • Download URL: genitext-0.3.2.tar.gz
  • Upload date:
  • Size: 204.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.0

File hashes

Hashes for genitext-0.3.2.tar.gz
Algorithm Hash digest
SHA256 5db88ebdde9210e61fad87c4239cc70b988b4cef606a9dcbddcd08c3d353230c
MD5 f035fc522e1acc8488c2512d28b166fa
BLAKE2b-256 54931e49ea50242e49f1ece03a7d760867ec66cc02bdd0c64edef50bb94c8b54

See more details on using hashes here.

File details

Details for the file genitext-0.3.2-py3-none-any.whl.

File metadata

  • Download URL: genitext-0.3.2-py3-none-any.whl
  • Upload date:
  • Size: 30.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.0

File hashes

Hashes for genitext-0.3.2-py3-none-any.whl
Algorithm Hash digest
SHA256 37e53999f55c6116b68b224583cd9dff815114e22b87275181fd9b381b018a10
MD5 09038943e24401c07a56b830ae164e20
BLAKE2b-256 7a6907546bc9ce1de8a8f128a6c366df380593cb2aa8d8946f37ae16164cfc2d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page