Issues

• Add Gemini 4 Argon

  LiveBench/LiveBench#568 · Filter by author andy-lz opened on Oct 8, 2026

• [Feature Request] Split "Cost per Successful Task" Insights by Output Length (Deterministic vs. Long-Form)

  LiveBench/LiveBench#559 · Filter by author David7ce opened on Oct 2, 2026

• Licence of the LiveBench leaderboard results (reuse in an open composite index with attribution)?

  LiveBench/LiveBench#558 · Filter by author lzyturtl opened on Oct 1, 2026

• connections scorer counts each copy of a repeated group, so one correct group repeated four times scores 1.0 and scores can exceed 1.0

  LiveBench/LiveBench#553 · Filter by author shaurya416 opened on Sep 23, 2026

• [Model Submission] Neuromantix v0.1.0 — Verified 97.0% Reasoning, 100% Data Analysis, 81% Math

  LiveBench/LiveBench#550 · Filter by author ModernOps888 opened on Sep 22, 2026

• LiveBench Test Request

  LiveBench/LiveBench#549 · Filter by author markw649 opened on Sep 22, 2026

• Optional EvalPort export for LiveBench's per-category process_results scores

  LiveBench/LiveBench#548 · Filter by author adhabnr-ux opened on Sep 22, 2026

• Add Xiaomi MiMo-V2.6-Pro-RL and MiMo-V2.6-Flash-RL

  LiveBench/LiveBench#547 · Filter by author laraws opened on Sep 22, 2026

• Historical run metadata for the 2026-06-25 logic_with_navigation scores

  LiveBench/LiveBench#540 · Filter by author anthesiallc opened on Sep 12, 2026

• [Question] Possibility to check non "Max effort" variations ?

  LiveBench/LiveBench#534 · Filter by author kaamui opened on Sep 4, 2026
  1

• Add Hy4-preview

  LiveBench/LiveBench#529 · Filter by author laraws opened on Aug 31, 2026

• OpenAI-compat: run_livebench.py --api-base /v1 exports LIVEBENCH_API_KEY

  LiveBench/LiveBench#521 · Filter by author cursor opened on Aug 28, 2026

• Hosted LiveBench 2026-06-25 evaluation request: Ruzzler Hard-7 modes

  LiveBench/LiveBench#513 · Filter by author nazerith21-spec opened on Aug 20, 2026

• LiveBench website livebench.ai suggestion

  LiveBench/LiveBench#511 · Filter by author celestinoxp opened on Aug 18, 2026

• Add Mumushibendan

  LiveBench/LiveBench#500 · Filter by author tamhonvotri opened on Aug 7, 2026
  1

• Add 5.3-codex

  LiveBench/LiveBench#497 · Filter by author vancromy opened on Aug 4, 2026
  1

• Where is the model effort variation option in the settings?

  LiveBench/LiveBench#491 · Filter by author CodesbyRobot opened on Aug 3, 2026
  1

• How long it takes, to run full battery of the single model/quant benchmarks, on AMD Strix Halo or DGX Spark?

  LiveBench/LiveBench#490 · Filter by author Sarajevo67 opened on Aug 1, 2026
  1

• model_judgment leaderboard split: 984 duplicate (model, question_id) rows, 64 with conflicting scores — double-weighted by show_livebench_result.py

  LiveBench/LiveBench#488 · Filter by author ipezygj opened on Jul 30, 2026

• Kimi K3 on LiveBench: Investigating the First-Run Accuracy Gap and Reasoning Effort Calibration

  LiveBench/LiveBench#483 · Filter by author blammectrappora opened on Jul 27, 2026

• Could you consider to add Mimo V2.5 (not V2.5 Pro)?

  LiveBench/LiveBench#474 · Filter by author letanloc1998 opened on Jul 17, 2026

• 5.6 sol medium

  LiveBench/LiveBench#459 · Filter by author codepharmer opened on Jul 12, 2026

• Please add Microsoft MAI-Models

  LiveBench/LiveBench#457 · Filter by author WaChris opened on Jul 10, 2026

• Request: Evaluate Xiaomi MiMo-V2.5 and MiMo-V2.5-Pro

  LiveBench/LiveBench#455 · Filter by author soker820 opened on Jul 9, 2026

• Model Evaluation Request: TemuClaude — 8-Model MoA Orchestration API

  LiveBench/LiveBench#453 · Filter by author notSaiful opened on Jul 7, 2026