Skip to content

Fix vllm models - #49

Open
BrownianNotion wants to merge 4 commits into
allenai:mainfrom
BrownianNotion:fix-vllm
Open

Fix vllm models#49
BrownianNotion wants to merge 4 commits into
allenai:mainfrom
BrownianNotion:fix-vllm

Conversation

@BrownianNotion

@BrownianNotion BrownianNotion commented Mar 9, 2026

Copy link
Copy Markdown

Fixes vllm models:

Tested with command

  olmes \
      --model "allenai/OLMo-2-0425-1B-Instruct" \
      --model-args '{"chat_model": true, "max_length": 4096, "metadata": {}, "trust_remote_code": true, "gpu_memory_utilization": 0.85}' \
      --model-type vllm \
      --task gsm8k::tulu ifeval::tulu \
      --task-args '{ "generation_kwargs": { "max_gen_toks": 4096, "truncate_context": false } }' \
      --output-dir "eval_results"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant