Command Palette

Search for a command to run...

UnylyUnyly
Browse all

Windows Computer Use

FreeNot checked

Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro re

GitHubEmbed

About

Windows Computer Use for AI Agents. Both a tool (22 MCP tools for click, type, screenshot, OCR, UI inspection) and an agent (autonomous mission engine, macro recorder, intent-based discovery, event watchers). Built with opencode (DeepSeek V4). Ships as MCP server, web UI, and Tauri desktop app.

README

Stars License Python FastMCP

Toolkit for building CUA agents on Windows - primitives an AI (or you) calls to see UI and click/type like a human, with a built-in mission agent included. Click buttons, type text, read windows, run whole missions autonomously. Built on pywinauto.

Dangerous by nature: every click and keystroke hits the live desktop and can change or delete real data. Keep HITL approval on; prefer dry-run or a VM sandbox (virtualization-mcp) for anything untrusted. Read docs/SAFETY.md before production use.

A tool for agents, and an agent itself.

You It
Use it as an MCP server Claude, Cursor, DeepSeek call automation_windows, automation_elements, automation_mission — 20 tools
Use it as an autonomous agent Give it a goal: automation_mission(run="install app, verify UI, screenshot result") — it plans, executes, retries, and reports
Use it as a webapp start.ps1 opens a React dashboard at http://127.0.0.1:10788 with HITL, crawler, logging
Use it as a desktop app The NSIS installer bundles everything into one binary — no Python, no uv, no git needed

Exhibit A: 100 Tauri/NSIS installers, one unattended run, $2 in LLM costs. Install, screenshot, verify, report — zero human intervention. That is what agentic Windows automation looks like at scale.

Built on pywinauto. Read docs/SAFETY.md before production use.


Quick Start

Claude Desktop (one line): download install.ps1 from the latest release, then run it — it installs the .mcpb bundle for you. Other clients: uvx / manual config snippets are in INSTALL.md.

Method Command / Config
MCP stdio (Cursor, Claude Desktop) { "mcpServers": { "windows-computer-use": { "command": "uv", "args": ["--directory", "<PATH>", "run", "windows-computer-use-mcp"] } } }
HTTP streamable (any MCP HTTP client) { "mcpServers": { "windows-computer-use": { "url": "http://127.0.0.1:10789/mcp" } } }
Web operator UI .\start.ps1 → http://127.0.0.1:10788
Desktop app (NSIS installer) Download from Releases — zero deps

See INSTALL.md for detailed setup. Run just demo for examples.


Features

  • Window Management — find, activate, maximize, minimize, position, close, tray icons
  • Mouse & Keyboard — click, drag, type, hotkeys, app shortcuts, background PostMessage input (no cursor warp)
  • UI Elements — inspect, click, read text, verify state via UIA / Win32
  • Visual Intelligence — screenshots, OCR, template matching
  • Tables & Virtual Lists — scroll-and-recrawl crawl, table-to-rows/CSV extraction
  • Autonomous Missions — give it a goal, it plans and executes with retry + verification (preflight + UAC pause + app allowlist built in)
  • Session Safety — preflight liveness check, UAC detection, per-app allowlist, HITL, kill switch
  • Macro Recording — record any UI sequence, replay, verify outcomes
  • Multi-App Workflows — chain actions across Notepad, Calc, Paint, or any Windows app
  • Telemetry — every action logged to SQLite; query failure patterns by tool
  • Adaptive Location — auto-cascades through title/auto_id/control_id/class/OCR to find elements
  • Face Recognition — optional, off by default

Documentation

Doc Content
INSTALL.md Setup: desktop app, uv, MCP config
docs/ONBOARDING.md First-timer setup: what to install, pitfalls, sanity check
docs/README.md Full documentation hub
docs/py-stack.md Python dependency deep dive
docs/composing-with-playwright.md Browser automation with Playwright MCP
docs/ocr.md OCR system — Tesseract setup, limitations, competition
docs/cua-nsis-certification.md Dogfooding: using the tool to test its own NSIS installer
docs/ROADMAP.md Improvement roadmap short/medium/long term
docs/SAFETY.md HITL, kill switch, opt-in features
docs/TOOLS.md Portmanteau tool reference
tests/README.md Test suite guide and e2e setup
examples/README.md Runnable demos
mcpb/README.md MCPB bundle packaging
web_sota/README.md Operator UI build/dev guide
CHANGELOG.md Release history

Ports

Port Service
10788 Frontend — Vite operator UI
10789 Backend — FastAPI + FastMCP HTTP
stdio MCP transport (port-free)

Related

Repo What it does
autohotkey-mcp Raw input recording/replay via AHK
browser-mcp Playwright browser control — for webapps, HTML DOM, websites
virtualization-mcp Sandbox / VM isolation
windows-operations-mcp Registry, services, accounts

Browser vs desktop: This server drives Win32 / UI Automation. For HTML/DOM and websites, pair with browser-mcp (Playwright). Both MCPs can run side by side — use one profile that loads both and let the LLM pick the right tool for the target.

Fleet standards: mcp-central-docs.


License

MIT — Copyright (c) 2026 Sandra Schipal.

from github.com/sandraschi/windows-computer-use-mcp

Installing Windows Computer Use

This server has no published package — it is built from source. Open the repository and follow its README.

▸ github.com/sandraschi/windows-computer-use-mcp

FAQ

Is Windows Computer Use MCP free?

Yes, Windows Computer Use MCP is free — one-click install via Unyly at no cost.

Does Windows Computer Use need an API key?

No, Windows Computer Use runs without API keys or environment variables.

Is Windows Computer Use hosted or self-hosted?

Self-hosted: the server runs locally on your machine via the install command above.

How do I install Windows Computer Use in Claude Desktop, Claude Code or Cursor?

Open Windows Computer Use on unyly.org, pick your client tab (Claude Desktop, Claude Code, Cursor) and press Install — the config is generated automatically, no JSON editing.

Related MCPs

LibreOffice Tools

Enables AI agents to read, write, and edit Office documents via LibreOffice with token-efficient design. Supports multiple formats including DOCX, XLSX, PPTX, a

passerbyflutterby passerbyflutter

Figma

Extract design specs and assets

Figmaby Figma

dannote/figma-use

Figma control: create shapes, text and components, and set styles, auto-layout, variables and exports.

dannoteby dannote

Logo.dev

Search and retrieve company logos by brand or domain. Customize size, format, and theme to match your design needs. Accelerate design, prototyping, and content

NOVA-3951by NOVA-3951

Design Inspiration Server

Searches top design platforms like Dribbble and Behance to provide UI inspiration, color palettes, and layout patterns via the Serper API. It allows users to re

YonasValentinby YonasValentin

PIX4Dmatic

Enables GUI automation for controlling PIX4Dmatic on Windows through MCP. Supports launching, focusing, capturing screenshots, sending hotkeys, clicking UI elem

jangjo123by jangjo123

mcp-dockmaster

An Open-Sourced UI to install and manage MCP servers for Windows, Linux and macOS.

by Community

ariekogan/ateam-mcp

Build, validate and deploy multi-agent AI solutions on the ADAS platform: design skills with tools and manage the solution lifecycle.

ariekoganby ariekogan

thinkchainai/mcpbundles

Create custom tool bundles, connect providers with OAuth or API keys, and use one MCP server across many integrations, with a UI for bundles and credentials.

thinkchainaiby thinkchainai

jau123/MeiGen-AI-Design-MCP

Image generation and editing with a curated prompt library, prompt enhancement and routing across local ComfyUI, MeiGen Cloud and OpenAI-compatible APIs.

jau123by jau123

Compare Windows Computer Use with

Not sure what to pick?

Find your stack in 60 seconds

Author?

Embed badge for your README

Browse similar

All design MCPs