Skip to content

MiniGPT4-Video

Understand video and add titles or captions

Visit official site

What MiniGPT4-Video is

The model is described as a multimodal system for video understanding that processes temporal visual data together with text, based on MiniGPT-v2 and an EVA-CLIP visual backbone.

What you can do with it

  • Caption a video and write matching taglines
  • Ask questions about video content and pull out its gist

Pros & cons

✓ What we like

  • Trained in stages on video-text pairs and question tuning
  • Gains are stated on MSVD, MSRVTT, TGIF and TVQA

! What to watch out for

  • The card lists pricing as unknown
  • Results are tied to the video and text inputs

FAQ

What does it work with?

The card names temporal visual data and text data.

Which benchmarks are named?

MSVD, MSRVTT, TGIF and TVQA are listed.

Last reviewed: 2026-11-15

More AI video generation tools

View all →

How we review