computer-use-mcp

computer-use-mcp

An MCP server enabling Claude to control your computer via screen capture, mouse, and keyboard.

93
Stars
12
Forks
0
Releases

Overview

💻 The computer-use-mcp project provides a model context protocol (MCP) server that lets Claude control your computer through screen capture, mouse, and keyboard actions. It emulates a near-identical interface to Anthropic's official computer-use guide, but is tailored for local setup and easier experimentation. The server communicates with the host using nut.js, enabling programmatic control of input devices and screen imagery. It is designed to be run locally and is compatible with multiple client tools, including Claude Desktop, Cursor, and Cline, each with JSON config snippets showing how to launch the MCP server with npx and the 'computer-use-mcp' package. The README also advises best practices, such as preferring keyboard shortcuts over mouse actions, and using the Rango extension to improve web navigation reliability. There is a strong emphasis on security and supervising the tool, especially given the potential risks of giving a model control over a real machine. The project provides workflow guidance: install, configure, test, and build.

Details

Owner
domdomegg
Language
TypeScript
License
MIT License
Updated
2025-12-07

Features

Keyboard-first nudging

The MCP server nudges the model to prefer keyboard shortcuts when interacting with the computer, reducing reliance on mouse clicks.

Nut.js-based control

Communicates with the host using nut.js to perform mouse, keyboard, and screen capture actions.

Anthropic Computer Use compatibility

Implements a near-identical interface to Anthropic’s official Computer Use guide, adjusted to favor keyboard-based interaction.

Local, easy setup

Designed to be easy to set up and run locally, with multiple client integration options.

Client integrations

Supports Claude Desktop, Cursor, and Cline clients with JSON-based configuration to wire up the MCP server.

JSON configuration examples

Includes sample mcpServers configurations for different clients to configure the server quickly.

Rango extension guidance

Recommends the Rango browser extension for reliable keyboard navigation on websites.

Audience

DevelopersThey integrate the MCP server to enable Claude to automate desktop tasks locally.
ExperimentersUsers experiment with AI-driven control of their computer for automation.
Automation EngineersAutomation engineers prototype desk automation and tasks via Claude locally.

Tags

MCPClaudecomputer-controlautomationscreen-capturenut.jslocal-setupdesktop-automation