Give your AI assistant eyes and hands on your phone and desktop.

ScreenMCP connects AI assistants to real device screens via the Model Context Protocol (MCP). Your AI can take screenshots, tap, swipe, type, scroll, capture from the camera, play audio, and interact with any app — just like a human would.

Works with Claude Desktop, Cursor, Claude Code, OpenClaw, and any MCP-compatible client.

AI Assistant (Claude, Cursor, etc.)
        ↕ MCP
   MCP Server (Node.js)
        ↕ WebSocket
      Worker (Rust)
        ↕ WebSocket
  Phone / Desktop App
        ↕ Accessibility APIs
       Device Screen

1. Install the app on your phone or desktop
2. Configure the MCP server in your AI client
3. Your AI can now see and control the device

# Clone the repo
git clone https://github.com/shimondoodkin/screenmcp.git
cd screenmcp

# Start with Docker
docker compose up

# Or manually:
# Worker (Rust, port 8080)
cd worker && cargo run

# MCP Server (Node.js, port 3000)
cd mcp-server && npm install && npm run build && npm start

[user]
id = "your-secret-token"

[auth]
api_keys = ["pk_your_api_key"]

[server]
port = 3000
worker_url = "ws://localhost:8080"

• Android: Download the APK from Releases

  • Enable Accessibility Service in Android Settings
  • In the app: enable "Open Source Server", enter your server URL and user.id token

• Windows: Download the .exe from Releases

  • In the app settings: enable "Open Source Server", enter your server URL and token

• Linux: Download the .deb from Releases

  sudo dpkg -i screenmcp-linux_0.1.0_amd64.deb

  • Launch ScreenMCP from your app launcher or run screenmcp-linux
  • In the app settings: enable "Open Source Server", enter your server URL and token

• macOS: Download the .dmg from Releases

  • Drag ScreenMCP to /Applications
  • Remove quarantine: xattr -cr /Applications/ScreenMCP.app
  • Grant Screen Recording and Accessibility permissions in System Settings
  • In the app settings: enable "Open Source Server", enter your server URL and token

Claude Desktop (~/Library/Application Support/Claude/claude_desktop_config.json):

{
  "mcpServers": {
    "screenmcp": {
      "command": "npx",
      "args": ["-y", "screenmcp-client"],
      "env": {
        "SCREENMCP_URL": "http://localhost:3000",
        "SCREENMCP_API_KEY": "pk_your_api_key"
      }
    }
  }
}

Or use the hosted version at https://mcp.screenmcp.com/mcp — see screenmcp.com for cloud setup.

See architecture.md for the full technical overview including auth flow, WebSocket protocol, and config file format.

screenmcp.com offers a hosted version with:

• No self-hosting required
• Firebase authentication
• Multi-device management dashboard
• Free tier available (100 commands/day, 2 devices)

Pull requests welcome! Please open an issue first for major changes.

• Open an issue
• See adding-new-command.md for how to add new device commands
• See architecture.md for system design

MIT — see LICENSE