agent-desktop

agent-desktop is an AI tool in the Agents & Bots category. Useful for computer use, AI agents, accessibility, CLI, MCP.

agent-desktop logo

Open-source CLI from Vercel Labs that gives AI agents computer use on macOS, Windows and Linux by reading the OS accessibility tree instead of screenshots.

CLI aberto da Vercel Labs que dá ao agente de IA uso do computador no macOS, Windows e Linux lendo a árvore de acessibilidade do sistema em vez de print de tela.

AITag Review

agent-desktop lets an agent operate desktop apps without screenshots or pixel matching. It reads the accessibility tree of an app and returns it as JSON, with a ref for every element; the agent acts on a ref, reads the UI again and checks the result. There is no model inside: the loop lives in your agent, which can call it as a CLI, a C library or an MCP server. Actions run headless by default, through the accessibility API, without moving your pointer. It is the desktop sibling of agent-browser, built in Rust and released under Apache 2.0.

Features

  • Category: Agents & Bots
  • Tags:
    computer useAI agentsaccessibilityCLIMCPdesktop automationRustopen source
  • Website:Visit
  • Curated: No