Dictionary entry
GUI agent
also graphical user interface agent or UI agent
Definition of GUI agent
-
: an AI agent that understands and operates a graphical user interface by actions such as clicking, typing, scrolling, dragging, and reading what appears on the screen
- The GUI agent booked the appointment by navigating the same website forms a person would use.
- A mobile GUI agent must recognize changing icons and menus instead of relying on a stable application programming interface.
Origin & history
GUI automation predates modern AI, but GUI agent became a common research label as multimodal foundation models began interpreting screenshots and taking actions across websites, desktop software, and mobile apps. Multiple surveys published in 2024 treated GUI agents as a distinct class of AI agents with perception, reasoning, planning, and action components.
Editorial references
Sources & further reading
- GUI Agents: A Survey↗ Research Survey · Findings of ACL / arXiv · 2024-12-18
- Large Language Model-Brained GUI Agents: A Survey↗ Research Survey · arXiv · 2024-11-27
- Learn from Move: the Next Step for GUI Agents↗ Research Paper · arXiv · 2026-10-14
Test yourself
Which of these is the meaning of GUI agent?
Cite this entry
"GUI agent." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/gui-agent/. Accessed 15 Oct. 2026.