Category Personal assistant
What AgentCPM-GUI is
The agent is described as an open-source on-device LLM agent designed to operate Chinese and English applications, executing tasks automatically from a user's screen screenshot and aimed at raising productivity on mobile devices.
What you can do with it
- Understand common GUI elements from a bilingual Android dataset
- Operate Chinese apps with dedicated fine-tuning
- Plan and reason before outputting an action through RFT
- Use a compact action space with a short JSON action format
Application scenarios
- Get restaurant information on Dianping from a screenshot and an instruction
- Let the agent browse video content on bilibili
- Direct the model to run navigation and route planning on Amap
Getting started
- Clone the AgentCPM-GUI code repository locally
- Install the required dependencies such as Python and related libraries
- Download the model and place it in the specified directory
- Load the model and tokenizer in code to prepare input data
Pros & cons
✓ What we like
- Bilingual Android pre-training plus fine-tuning for Chinese apps
- Reasoning before actions aims at higher success on complex tasks
! What to watch out for
- The described workflow depends on screenshots and user instructions
- The setup lists cloning the code, installing Python dependencies and downloading the model
FAQ
What does the agent act on?
The material states it carries out tasks automatically from a user's screen screenshot.
Which languages of apps are targeted?
It is designed to operate Chinese and English applications.
Last reviewed: 2026-11-15
More AI office assistant tools
View all →-
10xWinners OKR OKR tracking software that keeps company goals and team execution on one page Free tools Personal assistant Enterprise tools Office Task management -
1minAI One workbench for text, image, audio and video AI tasks under a single credit balance Free tools Workflow automation Multi model platform Audio Office -
1stCollab Influencer marketplace that matches brands with creators and manages the campaign Free tools Knowledge base Q&A Office Ad creative Lead generation -
20paths Interactive product demos built for explaining a product and driving conversion Free tools Knowledge base Q&A Office PPT generator Customer service automation -
6figr Salary data, offer checks and automated applications for people planning a move Free tools Knowledge base Q&A Office Enterprise automation -
A4F AI business consultants and a digital mentor for early-stage founders Free tools Freemium tools Enterprise tools Knowledge base Q&A Office