Yap
GitHub

for Claude Code, Codex & any agent

Just yap.
Your agent gets it.

Talk and point at your screen, then paste it to your agent. Or hand it one rough take for people. Yap gives your agent the eyes, ears and hands to get what you meant.

A person just yaps and circles a pin on their laptop; Xiaohei, the agent, untangles the rambling, gets it, and turns it into a fix and a great video

tell your agent to install it

Install Yap (the Mac app, which sets up the yap CLI and skill) by following https://justyap.io/llms.txt

The open buttons type the prompt into your agent without sending it.

Apple Silicon · macOS 26 or newer · Free

show your agent

Bug reports, design feedback, a pull request reviewed out loud, “watch me do it”. Four keys instead of three paragraphs:

  1. Start ⌥⇧S

    Records the display under your pointer. No countdown.

  2. Talk and draw hold ⇧

    Shift-click drops a numbered pin. ⌥⇧Z undoes a mark, ⌥⇧X cancels.

  3. Finish ⌥⇧S

    The transcript is prepared in the background.

  4. Paste ⌥⇧V

    A short prompt: the recording, what was captured, your marks and clicks.

Rebind the keys in Settings. No extra permission; allow Accessibility so ⌥⇧V can paste for you; otherwise it copies.

show people

Demos, team updates, podcasts and talks. One rough take instead of an editor:

  1. Record ⌥⇧S

    Same key, or drop in any video you already have.

  2. Ask ⌥⇧V

    Paste, then add “a 60-second demo with captions.”

  3. Review

    Your agent cuts, captions and cleans up.

  4. Export

    Video, audio or captions for where it’s going.

Originals stay untouched; every edit is a revision you can undo.

made with yap

An agent edited this launch video end to end with Yap.

Things you can just say

How it works

A person hands over a note in plain words while Xiaohei cuts the recorded film with huge scissors

in plain words

Yap, ask, done

Press ⌥⇧S and talk, record from the menu bar, or hand over a video you already have. Paste the prompt or ask in plain words. Your agent reads the transcript, looks at the frames and your pins, listens to the audio, then fixes what you showed, or cuts, captions and exports.

A toolbox holds the transcript, waveform and frames while Xiaohei, on a stool, marks the cut

the agent decides

Evidence, not opinions

Word-timed transcripts, frames, your marks and pins, waveforms, scene and cursor events, loudness. Yap supplies the facts; your agent makes the calls, so the result follows your intent, not a house style.

The original reel sits under a glass dome while Xiaohei pegs revisions on a line it can undo

non-destructive

Nothing to lose

The agent works on revisions. Preview, compare, undo or restore any of them. Letting an agent edit carries no risk.

Runs on your Mac

Recordings, transcripts and voice models stay local.

Originals untouched

Every edit is a revision you can undo. Source media stays byte-for-byte.

Your agent decides

Yap has no built-in agent and makes zero editorial calls. It hands yours evidence and precise tools.

Free

No account, no subscription. Free for now while it grows up.

Setting it up

for humans

  1. Paste the prompt into Claude Code or Codex

    Or click Open in Claude Code / Open in Codex above. Your agent downloads Yap, checks it, puts it in Applications and opens it.

  2. Yap sets up your agent

    On first launch the app installs the yap command and the yap skill, and keeps both current with every update. Turn this off in Settings → Set up my agents.

  3. Just yap

    Press ⌥⇧S to show your agent something and ⌥⇧V to hand it over, or record and ask for the video you want. Not happy? Say so in one more sentence.

for agents

Everything an agent needs is plain text at /llms.txt, or flip the switch up top.

# You're reading the agent view. Same words as /llms.txt

# Yap

> Just yap. Your agent gets it. Yap is a free macOS toolkit (a menu-bar app, the `yap` CLI and an agent skill) that gives Claude Code, Codex and other agent harnesses the eyes, ears and hands to record, understand and edit video locally. It works in two directions. Show your agent: the user records with a hotkey, talks, draws and drops numbered pins, then pastes a prompt that hands you the recording. Show people: the user hands you a rough take and you make it a polished, captioned video in the right format. Yap has no built-in agent and makes zero editorial decisions: the agent decides, Yap supplies evidence and precise, non-destructive operations, and originals are never touched.

Requirements: Apple Silicon, macOS 26 or newer. Linux and Docker cannot run the native app or capture media.

## Install

If your user asked you to install Yap, the request is:

    Install Yap (the Mac app, which sets up the yap CLI and skill) by following https://justyap.io/llms.txt

You install the app; the app installs the rest. The [installation procedure](https://raw.githubusercontent.com/dzhng/yap/main/skills/yap/references/installation.md) has the exact commands: check the Mac, resolve the latest release's tag once and download its `SHA256SUMS`, `release.json` and kit from that tag (the `latest/download` links can briefly mix two releases right after one is published), checksum-verify them, place Yap.app in /Applications or ~/Applications, and open it. Within a few seconds the app installs `~/.local/bin/yap`, the yap skill for every agent it finds, and a PATH line when one is missing. Then verify with `~/.local/bin/yap cli.status`, `skill.status` and `service.health` (use the full path: the PATH line reaches only new shells) and report a short checklist. [Agent setup](https://github.com/dzhng/yap#agent-setup) is the same in the README.

Facts that change what you do:

- Don't copy a launcher or run `npx skills add` yourself; the app owns both. Use the manual steps in the installation procedure only when `cli.status` or `skill.status` reports a problem.
- The app refuses to run outside /Applications or ~/Applications and offers to move itself.
- Releases are not notarized. A download made with `curl` is never blocked; a browser download needs System Settings → Privacy & Security → Open Anyway. Never remove quarantine attributes or disable Gatekeeper.
- Installation does not grant screen, microphone or camera permissions; the user grants them on first recording.

## Use

- A prompt the user pastes from Yap (⌥⇧V) names a recording ID, what was captured (screen, camera, microphone), and the user's marks, pins and clicks with their times and the window each was on. Every recording and import is transcribed in the background. Explore the recording with the yap CLI as the skill describes, then act on what the user showed you.
- [yap skill](https://raw.githubusercontent.com/dzhng/yap/main/skills/yap/SKILL.md): how to record, understand and edit video for the user with the toolkit. Start a fresh agent session after the app installs it so it is discovered (`/yap` in Claude Code, `$yap` in Codex).

## Optional

- [README](https://github.com/dzhng/yap): what Yap is, the hotkey loop, and what people make with it.
- [Positioning](https://github.com/dzhng/yap/blob/main/positioning.md): what is possible today, what isn't yet, and how Yap compares with the alternatives.
- [Latest release](https://github.com/dzhng/yap/releases/latest): the app kit, its release.json receipt and SHA256SUMS.