Skip to content

Ferret-UI-Llama8b

A multimodal model centred on user interfaces

Visit official site

What Ferret-UI-Llama8b is

The model is described as a multimodal large language model built for referring, grounding and reasoning on user interfaces.

What you can do with it

  • Download the needed Python files
  • Prepare an image file and a prompt text
  • Call inference_and_run with an optional bounding box

Pros & cons

✓ What we like

  • Dialogue on images and text is supported
  • Text generation from image content is included

! What to watch out for

  • The build is centred on user interface tasks
  • Inference needs local Python files and an image

FAQ

Which base models are named?

Gemma-2B and Llama-3-8B.

How is a region specified?

A bounding box can be passed to the inference call.

Last reviewed: 2026-11-15

More AI coding tools tools

View all →

How we review