Skip to content

AgentCPM-GUI

An open-source phone GUI agent that acts on screenshots

Visit official site

What AgentCPM-GUI is

The agent is described as an open-source on-device LLM agent designed to operate Chinese and English applications, executing tasks automatically from a user's screen screenshot and aimed at raising productivity on mobile devices.

What you can do with it

  • Understand common GUI elements from a bilingual Android dataset
  • Operate Chinese apps with dedicated fine-tuning
  • Plan and reason before outputting an action through RFT
  • Use a compact action space with a short JSON action format

Application scenarios

  • Get restaurant information on Dianping from a screenshot and an instruction
  • Let the agent browse video content on bilibili
  • Direct the model to run navigation and route planning on Amap

Getting started

  • Clone the AgentCPM-GUI code repository locally
  • Install the required dependencies such as Python and related libraries
  • Download the model and place it in the specified directory
  • Load the model and tokenizer in code to prepare input data

Pros & cons

✓ What we like

  • Bilingual Android pre-training plus fine-tuning for Chinese apps
  • Reasoning before actions aims at higher success on complex tasks

! What to watch out for

  • The described workflow depends on screenshots and user instructions
  • The setup lists cloning the code, installing Python dependencies and downloading the model

FAQ

What does the agent act on?

The material states it carries out tasks automatically from a user's screen screenshot.

Which languages of apps are targeted?

It is designed to operate Chinese and English applications.

Last reviewed: 2026-11-15

More AI office assistant tools

View all →

How we review