Skip to content
hridaya423Public

About

Ask how to do anything on your Mac. Perry points at the button in any app, or clicks it for you.

Topics

Resources

Stars

8 stars

Watchers

0 watching

Forks

Repository files navigation

Perry: hello. I am Perry. I live in your notch.

Ask how to do anything on your Mac.
Perry points at the button, or clicks it for you.

Free and open source. No account. Use the ChatGPT or Claude plan you already pay for, or any API key.

Download Perry for macOS

Latest release License: AGPL-3.0 macOS 14 or later on Apple Silicon Swift

Install · Features · Brains · Changelog · Issues


Perry in System Settings: the user asks how to turn on dark mode, Perry points at Appearance, then at Dark, then clicks Do it for me and the Mac switches to dark mode
Real screen recording, sped up in places. Perry points at Appearance, then at Dark, then does the last step.

Perry opens from the notch at the top of your screen. Hold ⌃⌥ and talk, or type. Ask how to do something, and Perry points at each control in the app you have open. Ask Perry to do the task, and it does the work while you watch, with a stop button always in reach.

Note

Perry is in public beta. Report problems through Issues.

What Perry does

A guide step in the notch: Step 2, Choose the project folder in the sidebar, with Done and Do it for me buttons

Show me how

Perry points at one control, waits for you to click it, then points at the next one. Click Do it for me at any step, and Perry takes over.

A running task in the notch: Preparing meeting notes, Writing the outline, with a progress bar and Pause, Take over and Stop buttons

Do it for me

Perry works in the background and logs each action. Pause, take over or stop at any time. Perry asks once before any action that you cannot undo.

A conversation in the notch: the question Summarize the meeting and Perry's answer with next steps

Ask about your screen

Ask a question about the window in front of you. Perry reads it only while you ask, and answers in the notch.

The Routines page: a saved routine named Prepare project notes with two steps and a Run now button

Routines

Show Perry a task once, and it saves the steps as a routine. Perry checks the current app before each step when it runs one again.

Perry also connects to Slack, Notion, Linear and Google Workspace. Helpers run a job on a schedule, for example a morning summary of your newsletters.

Bring your own brain

Perry has no account and no subscription. Pick the model that does the thinking in Settings → Brain.

Brain What you need
ChatGPT A ChatGPT plan. Perry runs the bundled Codex runtime.
Claude Code A Claude plan and the Claude Code CLI.
API key A key for OpenAI, Anthropic, Gemini, OpenRouter, xAI, Groq, Cerebras, Mistral, DeepSeek, Together, Fireworks, or any OpenAI-compatible endpoint.
On this Mac Nothing. Perry answers in text until you set up a brain. Local servers such as Ollama also work.
ACP agent Any agent from the Agent Client Protocol registry, such as Gemini CLI or Goose.

Perry stores API keys in the macOS Keychain.

Privacy

  • Screen capture runs only during a session that you start.
  • Perry never reads or acts in banking, password manager or checkout windows.
  • Memory starts only after you agree during onboarding. Erase it by category or in full.
  • Perry has no server and no telemetry. Requests go only to the brain and the integrations that you choose.

Install

Perry needs a Mac with Apple Silicon and macOS 14 or later.

  1. Download Perry-0.1.0.dmg from the latest release.
  2. Open it and drag Perry to Applications.
  3. Open Perry. It explains Accessibility, Screen Recording and Microphone access before macOS asks for each one.

The app is signed with a Developer ID and notarized by Apple. Later versions arrive through the built-in updater.

Build from source

Building also needs Xcode.

git clone https://github.com/hridaya423/perry.git && cd perry
./scripts/fetch-codex-runtime.sh --fetch
./scripts/fetch-agent-desktop.sh --fetch
./scripts/fetch-cua-driver.sh --fetch
./scripts/fetch-xcodegen.sh --fetch
build/tools/xcodegen/bin/xcodegen generate --spec project.yml
xcodebuild build -project Perry.xcodeproj -scheme Perry -configuration Debug \
  -derivedDataPath build/debug-p1 -destination 'platform=macOS,arch=arm64'
open build/debug-p1/Build/Products/Debug/Perry.app

Each fetch script checks its download against the SHA-256 in scripts/*.lock.

Tip

If macOS forgets the permissions after each rebuild, sign Debug builds with your team identity in Config/DebugSigning.local.xcconfig. Git ignores this file.

How it works

Perry plans with your brain, acts through agent-desktop, and checks the screen after each step. Each session binds to one app and one window. cua-driver delivers the clicks and drags that agent-desktop misses, without moving your cursor. PRD.md has the architecture and the trust tiers. DESIGN.md has the visual language.

Development

project.yml generates Perry.xcodeproj. Do not edit the project by hand. Add files under App/ or Packages/, then run XcodeGen again.

swift test --package-path Packages/PerryCore
./scripts/test-release-automation.sh
./scripts/performance/self-test.sh
Path Contents
App/ The app: notch workspace, onboarding, settings, controllers
Packages/PerryCore Shared types, the trust guard, the activity log, Keychain, hotkeys
Packages/PerryBrain Model providers, conversation context, the perry-mcp server
Packages/PerryRuntimes Runtime adapters and the Do supervisor
Packages/PerryGuide The guide engine, tasks, routines and per-app notes
Packages/PerryOverlay The Perry character, ink strokes and the screen overlay
scripts/ Runtime fetchers, release tooling and lab drills

License

AGPL-3.0

About

Ask how to do anything on your Mac. Perry points at the button in any app, or clicks it for you.

Topics

Resources

Stars

8 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages