Small decisions. Interesting possibilities.Submit contentSubmit

How it uses Jev

The loop reads accessible interface text and indexed controls, then sends the goal, app, bounded context, recent actions, constraints, and candidate labels to Jev. Jev chooses a target and action, judges whether the goal is visibly done, and flags whether the action needs confirmation. Codex CUA performs reading and execution; local policy gates sensitive actions.

What Jev decides

Illustrative Jev requestExample answers · not a recorded Jev response · Source ↗
Question 1 · action
YOUR APP
INSTRUCTION

What is the next action type?

STATE

Goal, app/context, candidate elements, recent actions and constraints.

JEV · CHOICE
  1. click_element
  2. click_at
  3. drag
  4. set_value
  5. type_text
  6. press_key
  7. scroll
  8. wait
  9. ask_user

App workflow

  1. Observe the interface

    The CUA driver reads accessible controls and a small window/focus context for the selected app.

  2. Prepare a bounded request

    Code clips candidate controls, includes the goal and recent actions, and constructs the target, action, done, and risk questions.

  3. Apply the policy gate

    Local policy evaluates the chosen action and risk signal; sensitive operations pause for user confirmation.

  4. Execute or preview

    The loop runs the selected CUA step or records it in dry-run, then observes the interface again up to the step limit.

Why it is interesting

It makes the action, target, completion, and risk judgments explicit while sending text rather than screenshots. The default is dry-run, and policy plus app allow-lists constrain consequential actions.