vercel-labs/agent-desktop
- Stars
- 21,339
- Language
- Rust
- License
- Apache-2.0
- Weekly
- rank 2 · +12,120 stars gained
Repository metrics were observed on this edition date and may have changed.
Key Details agent-desktop is a desktop control tool that reads the operating system's accessibility tree as JSON and uses element references to click and enter text. It works without screenshots or pixel matching and provides CLI, C library, and MCP interfaces. The calling agent supplies the model and iterative control logic. Use Cases The workflow involves obtaining element references from a snapshot of the target app, performing actions, and checking the results with a new snapshot. For complex screens, the full structure can be read first before narrowing the scope to a specific area. Costs and Limitations The code is licensed under Apache-2.0 and does not include its own model. Paid API or model subscription costs for the connected agent are separate, and local computing resources are also required. The pricing terms for the tool's distribution need to be checked. Adoption Considerations Check the specified platform requirements, including macOS 13+, Windows 10 1809+, and Ubuntu 24.04+, as well as accessibility permissions. References must be refreshed when the screen changes, and snapshots, clipboard contents, and trace data may contain personal information. Why It Stands Out It was observed at No. 2 on weekly Trending, with an increase of 12,120 stars. Version v1.2.0, posted on 2026-11-05, included MCP support and standard input support for text commands.
View on GitHub