Record browser actions and replay them with AI-powered automation.
AutoPattern includes:
- Chrome extension to capture workflow events
- FastAPI backend to convert events into actionable tasks
- CLI for chat-mode or server-only execution
- Browser automation using Playwright + browser-use
- Gemini integration for workflow interpretation
- macOS / Linux / Windows
- Python 3.13+
- Chrome
Use pipx for a global CLI with isolated dependencies.
brew install pipx
pipx ensurepath
pipx install autopatternRun:
autopatternUse uv for fast, isolated local development.
cd backend
uv venv
source .venv/bin/activate
uv pip install -e ".[dev]"Run locally:
autopattern
# or
autopattern --serverRun tests:
pytestCreate backend/automation/.env:
GOOGLE_API_KEY=your_key_here
LLM_MODEL=gemini-flash-latest
HEADLESS=falseNotes:
GOOGLE_API_KEYis requiredLLM_MODELandHEADLESSare optional
autopatternautopattern --serverautopattern --task "Open GitHub and search for browser-use"Build:
cd backend
python -m buildArtifacts are created in backend/dist/.
- Runtime dependencies are version-ranged in
backend/pyproject.toml browser-useis pinned to stable 0.11.x range:browser-use>=0.11.0,<0.12.0
- Use
pipxfor user installs,uvfor development
Ensure .env exists at:
backend/automation/.env
cd backend
deactivate 2>/dev/null || true
rm -rf .venv
uv venv
source .venv/bin/activate
uv pip install -e ".[dev]"MIT