Tags AI Models
What magma is
The model is described as a multimodal foundation model from Microsoft Research that joins vision, language and action. It is pretrained on large vision-language data for planning tasks.
What you can do with it
- Navigate a web or mobile UI from an instruction
- Plan robot pick-and-place actions from visual input
- Answer questions about video content
Key features
- Set-of-Mark and Trace-of-Mark techniques
- Zero-shot adaptation to unseen tasks
- Multimodal input of image, video and language
Getting started
- Get the model and code from the official site or GitHub
- Choose a pretrained model version for the task
- Fine-tune with a small amount of labeled data if needed
- Pass images, video or text instructions into the model
Pros & cons
✓ What we like
- Spatial reasoning and action planning
- Video question answering is supported
! What to watch out for
- Some tasks use a small amount of labeled data for fine-tuning
- A pretrained model version must be chosen per task
FAQ
Who released it?
The material names Microsoft Research.
Which tasks are named?
UI navigation, robot manipulation and video QA.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform