Category AI image generation
Tags Text to image
What DIG-In is
DIG-In is described as a library for evaluating differences in quality, diversity and consistency of text-to-image generation models across geographic regions. The library supports researchers and developers auditing the geographic diversity of image generation models.
What you can do with it
- Compare generated image quality with GeoDE and DollarStreet
- Compute precision, recall, coverage and density metrics
- Measure image consistency with the CLIPScore metric
- Run scripts that extract features from generated images
Application scenarios
- Researchers compare model output quality in African regions
- Developers check consistent user experience across the globe
- Educational institutions teach evaluation of model fairness
Getting started
- Generate images that correspond to prompts in a csv file
- Point to the prompt csv and the generated image folder to extract features
- Compute metrics such as precision, recall, coverage and density from the features
- Update feature file paths as needed
Pros & cons
✓ What we like
- Scripts are provided to extract features from generated images
- Pointers to custom image or feature paths are supported
! What to watch out for
- The audit is framed around text-to-image generation models
- Metrics depend on features extracted from generated images
FAQ
Which datasets are used?
The material names GeoDE and DollarStreet as reference datasets.
What metrics are computed?
The feature list names precision, recall, coverage and density, plus CLIPScore for consistency.
Last reviewed: 2026-11-15
More AI image generation tools
View all →-
123RF Stock library with integrated AI image tools Free tools Text to image Image editing Background remover Image upscaler -
360智图 Image search, licensing and AI editing from 360 Free tools Text to image Background remover Product image Model generator -
360鸿图 Image generation aimed at Chinese-speaking users, with prompts written in Chinese Free tools Creator tools Text to image Art generator Image to image -
a1.art Filter-driven image generation with face swap Free tools Creator tools Text to image Art generator -
AI Anime Generator Photos and text into anime-style art Freemium tools Creator tools Text to image Image to image Image to video -
AI Art Generator Text prompts into original artwork drafts Freemium tools Creator tools Text to image Image editing Art generator