Tags · AIcrowd/whestbench

Repository navigation

v0.16.1

whestbench 0.16.1

Raises the flopscope floor to 0.12.1, which makes a symmetry tag describe the
buffer it is attached to. No already-scored submission is repriced: the one
change that moves a price is full/full_like with a non-scalar fill_value, and
no scored submission in the current phase passes one.

Also ships mc_flops_per_sample(), which publishes the cost of one Monte-Carlo
sample -- the MC@B_m baseline submissions are compared against. It adds a
helper and changes no score.