Glossary › Computer-Use Agent
Computer-Use Agent
An agent that operates a graphical interface the way a person does: it looks at a screenshot, decides where to click or type, and acts. Contrast with agents that call APIs or run shell commands. Slower and more fragile, but works with software that has no API.
Where Computer-Use Agent shows up
All matching postsComputer-Use and Voice Agents: How They Work
Two kinds of agent broke out of the text box: computer-use agents that operate a screen with a mouse and keyboard, and voice agents that hold a real-time spoken conversation. Here is how each works, where they are fragile, and what the harness has to do differently for them.
#computer-use#voice-agents#agent-engineering#agents#ai-security