Skip to main content

Framework to create labeling data from VLM and other larger models for computer vision tasks

Project description

Vision Loom

Leverage Vision Language Models to label images and create training data for other computer vision tasks.

Vision Loom is an automated labeling framework designed to bridge the gap between high-reasoning Foundation Models and real-time edge deployment. Leverage the "zero-shot" capabilities of Vision-Language Models (VLMs) to generate high-fidelity training data without the manual overhead.

Model Task Reference
Grounding Dino Tiny Object Detection detector_test.py
SAM-2 Object Segmentation segmentation_test.py

Save detection results

  • Install the library. Install the latest version for the updated features and comments.
pip install vision-loom
from vision_loom.models.grounding_dino import GroundingDINO 
from vision_loom.utils.io import load_images 
  • Enter a single image or path to a folder containing images
images = "vision_loom/test_notebooks/test_images"
dataloader = load_images(images)
  • Once the data loader is created, type in the items you want to detect and create the bounding boxes for. If your set of images has multiple objects over multiple images, I recommend giving the prompt for all the objects together to save compute.
prompt = [["car", "person", "book", "bike"]]
  • Run the pipeline.
for img_path, image in tqdm(dataloader):
    results = model.detect(image, prompt, img_path, save_results=True)

Detector Pipeline V1

📦 Releases

See CHANGELOG for version history.

Roadmap

  • Add Image Classification Support
  • Options for export to classical SOTA formats like YOLO, COCO etc.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vision_loom-0.2.2.tar.gz (19.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

vision_loom-0.2.2-py3-none-any.whl (18.3 kB view details)

Uploaded Python 3

File details

Details for the file vision_loom-0.2.2.tar.gz.

File metadata

  • Download URL: vision_loom-0.2.2.tar.gz
  • Upload date:
  • Size: 19.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.19

File hashes

Hashes for vision_loom-0.2.2.tar.gz
Algorithm Hash digest
SHA256 24075a4b6b4f5b1319e671db6301b749e53605cd486a74f18be777117265c9c8
MD5 61d4a9cf53f7d6a973fc4a112d3b144a
BLAKE2b-256 6f93d9c2adb2181c6fd795f78acbe0ccde3d4589c91210fe053c9418d5d0504d

See more details on using hashes here.

File details

Details for the file vision_loom-0.2.2-py3-none-any.whl.

File metadata

  • Download URL: vision_loom-0.2.2-py3-none-any.whl
  • Upload date:
  • Size: 18.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.19

File hashes

Hashes for vision_loom-0.2.2-py3-none-any.whl
Algorithm Hash digest
SHA256 444e7792d6463fded5f88fc5734ca3ecd87effd87ecbaff61afa7a1320529794
MD5 55db209774972357f8e269e762f7edd6
BLAKE2b-256 d9fb25fd2e2ce29bf0c389d6419c71f19b56e00ded4c1141900487accb1ecf5d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page