Skip to content

auraoneai/rubric-studio-open

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

152 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Rubric Studio Open

Rubric Studio Open is a local-first IDE for authoring, validating, previewing, calibrating, diffing, and exporting criterion-level AI evaluation rubrics.

30-second demo of Rubric Studio Open authoring, preview, calibration, diff, export, and settings surfaces

The app is intentionally single-user and file-based. A rubric is a folder on disk, so it can be reviewed in Git, shipped in CI, and exported into downstream evaluation runners without a hosted account.

Launch QA assets: authoring, preview scoring, calibration, diff, export, and short workflow video.

Production captures from https://rubric-studio.auraone.ai: authoring, preview, calibration, diff, export, and settings.

Production docs and website captures: docs home and AuraOne product page.

Install

Download the verified macOS Apple Silicon DMG from GitHub Releases:

Or run the browser IDE immediately:

Browser IDE: rubric-studio.auraone.ai

Build from source:

git clone https://github.com/auraoneai/rubric-studio-open.git
cd rubric-studio-open
pnpm install
pnpm dev

Product page: auraone.ai/open/rubric-studio-open

Docs: docs.rubricstudio.auraone.ai or local docs

Privacy: local-first privacy and telemetry policy

Roadmap and RFC process: public roadmap and maintainer-gated RFCs

Current surfaces

  • Desktop shell: Tauri 2 scaffold with a Rust core in src-tauri/.
  • Browser editor: Vite/React surface with browser constraints available through ?surface=browser.
  • VS Code surface: extension scaffold under vscode-extension/ with a webview editor command, live rubric TOML diagnostics, completions, and quick fixes.

Run locally

pnpm dev

Open http://127.0.0.1:5174/?surface=browser to exercise the browser edition.

Verify

pnpm typecheck
pnpm test
pnpm test:readme
pnpm test:privacy
pnpm build
pnpm vscode:contract
pnpm vscode:typecheck
pnpm tauri:core:test

Project format

The example project in examples/helpful-response-evaluation/ shows the v0 folder layout:

rubric.toml
themes/*.md
criteria/<theme>/*.toml
samples/*.jsonl
judges/*.toml
exports/
.rubric/

The TypeScript domain model and Rust validator both enforce the same core contract: stable criterion IDs, required labels/descriptions, bounded weights, example guidance, explicit evidence requirements, and deterministic scoring fixtures.

Open-source boundary

Rubric Studio Open does not include hosted queues, payments, reviewer workforce management, multi-tenant RBAC, adjudication operations, or Cloud approval chains. The only commercial handoff is the explicit export flow labelled "Send to AuraOne for expert review"; it packages an intake artifact only after user confirmation.

About

Local-first IDE for authoring, testing, calibrating, diffing, and exporting AI evaluation rubrics.

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors