Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Dec 20, 2024

• Clean up Markdown formatting in "Enterprise benchmark" documentation (#3243)

  yifanmai

  authored
  1224774View commit details

  Copy full SHA for 1224774

  Browse repository at this point

• Make encrypt_scenario_states script idempotent (#3242)

  yifanmai

  authored
  099a6c0View commit details

  Copy full SHA for 099a6c0

  Browse repository at this point

• Build frontend (#3236)

  Show description for 5bd2fbb
  

  github-actions[bot]

  and

  yifanmai

  authored
  5bd2fbbView commit details

  Copy full SHA for 5bd2fbb

  Browse repository at this point

• Add MedAlign scenario (#3038)

  Show description for 5e9bf74
  

  aunell

  and

  yifanmai

  authored
  5e9bf74View commit details

  Copy full SHA for 5e9bf74

  Browse repository at this point

• Add landing page for HELM Capabilities leaderboard (#3241)

  yifanmai

  authored
  66eba9fView commit details

  Copy full SHA for 66eba9f

  Browse repository at this point

• Fix incorrect file path in CzechBankQAAnnotator (#3240)

  yifanmai

  authored
  d74392dView commit details

  Copy full SHA for d74392d

  Browse repository at this point

• Bump jinja2 version (#3239)

  yifanmai

  authored
  f368e67View commit details

  Copy full SHA for f368e67

  Browse repository at this point

• Adding TweetSentBR Scenario (#3219)

  thallysonjsa

  authored
  9839a8cView commit details

  Copy full SHA for 9839a8c

  Browse repository at this point

• Fix incorrect package name in WildBenchAnnotator (#3234)

  yifanmai

  authored
  4b8dc91View commit details

  Copy full SHA for 4b8dc91

  Browse repository at this point

• Add Encryption for GPQA (#3216)

  liamjxu

  authored
  be8ac6bView commit details

  Copy full SHA for be8ac6b

  Browse repository at this point

• Update run entries config for Nova (#3235)

  yifanmai

  authored
  b01f5f6View commit details

  Copy full SHA for b01f5f6

  Browse repository at this point

• Add more instructions customization to output_format_instructions run expander (#3233)

  yifanmai

  authored
  6871ecfView commit details

  Copy full SHA for 6871ecf

  Browse repository at this point

• Add Safety to the Reproducing Leaderboards documentation (#3232)

  yifanmai

  authored
  bf2edeaView commit details

  Copy full SHA for bf2edea

  Browse repository at this point

• Fix template import in WildBenchAnnotator (#3231)

  yifanmai

  authored
  c28a842View commit details

  Copy full SHA for c28a842

  Browse repository at this point

• Build frontend (#3155)

  Show description for 1bf82b4
  

  github-actions[bot]

  and

  yifanmai

  authored
  1bf82b4View commit details

  Copy full SHA for 1bf82b4

  Browse repository at this point

• Add links to enterprise benchmarks documentation (#3230)

  yifanmai

  authored
  43e02e1View commit details

  Copy full SHA for 43e02e1

  Browse repository at this point

• Added openai/o1-2024-12-17 and openai/gpt-4o-2024-11-20 (#3228)

  teetone

  authored
  2719930View commit details

  Copy full SHA for 2719930

  Browse repository at this point

• Update CzechBankQA (#3227)

  yifanmai

  authored
  9561ec9View commit details

  Copy full SHA for 9561ec9

  Browse repository at this point

• Add IBM logo to partners (#3229)

  yifanmai

  authored
  a4f8b9eView commit details

  Copy full SHA for a4f8b9e

  Browse repository at this point

Commits on Dec 19, 2024

• Add run entries for HELM capabilities (#3226)

  yifanmai

  authored
  8164530View commit details

  Copy full SHA for 8164530

  Browse repository at this point

• Fixes to HELM capabilities (#3225)

  yifanmai

  authored
  f14e139View commit details

  Copy full SHA for f14e139

  Browse repository at this point

• Enterprise benchmark README (#3211)

  ryokawajp

  authored
  85a4479View commit details

  Copy full SHA for 85a4479

  Browse repository at this point

• Make boolean arguments for run spec functions case-insensitive (#3224)

  yifanmai

  authored
  318c3d9View commit details

  Copy full SHA for 318c3d9

  Browse repository at this point

• Set max_tokens to 512 and stop_sequences to empty list for Unitxt (#3223)

  yifanmai

  authored
  d05e2baView commit details

  Copy full SHA for d05e2ba

  Browse repository at this point

• Add experimental CzechBankQA scenario (#3222)

  yifanmai

  authored
  624c606View commit details

  Copy full SHA for 624c606

  Browse repository at this point

• Example scripts for AutoClient and ServerService make_request usage (#3221)

  yifanmai

  authored
  ea43767View commit details

  Copy full SHA for ea43767

  Browse repository at this point

Commits on Dec 18, 2024

• Re-release Lite v1.12.0 (#3220)

  yifanmai

  authored
  924e136View commit details

  Copy full SHA for 924e136

  Browse repository at this point

• Revert Lite to v1.11.0 (#3218)

  yifanmai

  authored
  35f2cf4View commit details

  Copy full SHA for 35f2cf4

  Browse repository at this point

• Release Lite and MMLU v1.12.0 (#3217)

  yifanmai

  authored
  5d7fb7dView commit details

  Copy full SHA for 5d7fb7d

  Browse repository at this point

• Bump nanoid from 3.3.6 to 3.3.8 in /helm-frontend in the npm_and_yarn group across 1 directory (#3209)

  Show description for 620fe6b
  dependabot[bot]

  authored
  620fe6bView commit details

  Copy full SHA for 620fe6b

  Browse repository at this point

• Revert triton version to 2.2.0 (#3215)

  yifanmai

  authored
  8a513d1View commit details

  Copy full SHA for 8a513d1

  Browse repository at this point

Commits on Dec 17, 2024

• Update requirements.txt (#3214)

  Show description for 1c282f7
  

  github-actions[bot]

  and

  yifanmai

  authored
  1c282f7View commit details

  Copy full SHA for 1c282f7

  Browse repository at this point

• Limit anthropic to <0.39 (#3213)

  yifanmai

  authored
  a752e72View commit details

  Copy full SHA for a752e72

  Browse repository at this point

Commits on Dec 16, 2024

• Adding BigCodeBench (#3186)

  liamjxu

  authored
  77c879dView commit details

  Copy full SHA for 77c879d

  Browse repository at this point

Commits on Dec 14, 2024

• Add gemini-2.0-flash-exp model (#3210)

  yifanmai

  authored
  e577004View commit details

  Copy full SHA for e577004

  Browse repository at this point