Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
-
Updated
Apr 13, 2026 - Python
#
ai-benchmark
Here are 148 public repositories matching this topic...
An agent benchmark with tasks in a simulated software company.
-
Updated
Nov 17, 2025 - Python
Frontier Models playing the board game Diplomacy.
-
Updated
Jun 1, 2026 - Python
Track 17,170+ AI benchmark, eval, dataset, and data-quality records from 37 public sources, with linked evidence and daily updates.
benchmarking benchmark evaluations evaluation benchmarks datasets benchmark-framework eval benchmark-suite evaluation-framework benchmark-datasets model-cards llm-evaluation ai-benchmark agent-benchmark agentic-benchmarking agent-benchmarking agent-bench agent-benchmarks agentic-benchmark
-
Updated
Sep 22, 2026 - Python
Ranking LLMs on agentic tasks
-
Updated
May 21, 2026 - Jupyter Notebook
The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai
-
Updated
Jul 20, 2026 - Python
开源劳动者AI研究与评测项目：建设劳动知识、公开评测基准与共同治理机制｜Open worker-centered AI research and evaluation project.
labor-rights workers-rights ai-ethics working-class responsible-ai ai-evaluation ai-governance open-source-ai ai-benchmark worker-ai algorithmic-management worker-centered-ai working-class-ai labor-studies
-
Updated
Sep 6, 2026 - Python
AI clothes swap prompt cookbook with 50 virtual try-on prompts, KIE GPT Image before/after examples, failure fixes, and a benchmark rubric for AIClothSwap.
image-editing before-after virtual-try-on fashion-ai prompt-examples outfit-generator ai-benchmark ecommerce-fashion gpt-image prompt-cookbook ai-clothes-swap ai-clothes-changer ai-dress-up clothes-color-changer aiclothswap virtual-try-on-prompts kie-gpt-image
-
Updated
Jul 9, 2026 - HTML
llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while providing deep hardware intelligence.
-
Updated
Mar 15, 2026 - Python
🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems
testing qa benchmark machine-learning evaluation chaos artificial-intelligence chaos-monkey testing-tools awesome-list quality-assurance ai-safety ai-agents chaos-engineering llm llm-evaluation agentic-ai ai-benchmark agent-evaluation
-
Updated
May 28, 2025
A visual benchmark testing whether leading coding agents repeat the same design patterns across 100 neutral website briefs.
-
Updated
Sep 19, 2026 - HTML
📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.
benchmark machine-learning ai leaderboard text-to-video llm lmsys ai-benchmark chatbot-arena arena-ai
-
Updated
Sep 21, 2026 - Python
Benchmarking and evaluation resources for trust, robustness, and reliability analysis in graph-based AI systems.
-
Updated
Sep 11, 2026 - Python
MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments and tool use. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek, Mistral AI, xAI, Alibaba, Moonshot AI, OpenRouter), custom tasks in YAML, and HTML/CSV/JSON reports.
opensource openai xai artificial-intelligence-projects anthropic ai-tool openrouter qwen deepseek mistral-ai llm-evaluation-framework google-gemini-ai llm-benchmarking moonshot-ai language-models-ai llm-comparison ai-benchmark ai-evaluation-tools grok-ai ai-model-comparison
-
Updated
Sep 22, 2026 - Go
Precision-aware retrieval benchmark for LLM memory systems.
benchmark information-retrieval ai memory evaluation memory-benchmark ai-agents long-term-memory rag llm ai-memory ai-benchmark memory-evaluation
-
Updated
Sep 17, 2026 - TypeScript
The document extraction benchmark by Flexprice
-
Updated
Sep 21, 2026 - Python
A curated list of evaluation tools, benchmark datasets, leaderboards, frameworks, and resources for assessing model performance.
-
Updated
Sep 6, 2026 - Python
GDB: GraphicDesignBench - A real-world benchmark for evaluating AI on graphic design tasks
svg design benchmark layout evaluation typography graphic-design lottie vlm multimodal vision-language-model ai-benchmark
-
Updated
May 5, 2026 - Python
Benchmark abierto en español de modelos de IA para negocios y agentes, con juez independiente (Phi-4). Calidad, costo, velocidad, contexto largo, trabajo agéntico y fuga de credenciales, cada uno por separado. Calculadora interactiva con tus propios pesos.
ai-agents startup-tools n8n ai-models emprendedores openrouter ollama llm-evaluation llm-comparison ai-benchmark llm-benchmark spanish-ai openclaw hermes-agent claude-alternatives gpt-alternatives phi4-judge benchmark-en-espanol emprendedores-ia
-
Updated
Sep 21, 2026 - Python
中国创作者给全球 AI 出的一场真实大考 | A searchable index of Bilibili AI Infinite Arena videos.
-
Updated
Sep 18, 2026 - JavaScript
Add this topic to your repo
To associate your repository with the ai-benchmark topic, visit your repo's landing page and select "manage topics."