Commits

Branch selector

 main

User selector

WoosukKwon

All time

Commit History

Commits on Feb 10, 2026

• [Model Runner V2] Use pinned memory for write_contents (#34222)

  Show description for a2443de
  WoosukKwon

  authored
  a2443de

  Copy full SHA for a2443de

Commits on Jan 28, 2026

• [Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059)

  Show description for 46ec6d7
  

  WoosukKwon

  and

  njhill

  authored
  46ec6d7

  Copy full SHA for 46ec6d7

Commits on Jan 27, 2026

• [Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055)

  Show description for 6d86fde
  

  WoosukKwon

  and

  njhill

  authored
  6d86fde

  Copy full SHA for 6d86fde

Commits on Jan 26, 2026

• [Model Runner V2] Add LoRAState to consolidate lora logic (#33062)

  Show description for a9b53dd
  WoosukKwon

  authored
  a9b53dd

  Copy full SHA for a9b53dd

• [Model Runner V2] Minor simplification for finish_requests (#33048)

  Show description for 2f0d3ba
  WoosukKwon

  authored
  2f0d3ba

  Copy full SHA for 2f0d3ba

• [Model Runner V2] Fix slot_mapping after #25954 (#33046)

  Show description for edf927b
  WoosukKwon

  authored
  edf927b

  Copy full SHA for edf927b

Commits on Jan 22, 2026

• [Model Runner V2] Do not error on attention backends (#32820)

  Show description for 5e00b56
  WoosukKwon

  authored
  5e00b56

  Copy full SHA for 5e00b56

Commits on Jan 21, 2026

• [Model Runner V2] Refactor Prompt Logprobs (#32811)

  Show description for 408195e
  WoosukKwon

  authored
  408195e

  Copy full SHA for 408195e

• [Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794)

  Show description for e1da249
  WoosukKwon

  authored
  e1da249

  Copy full SHA for e1da249

Commits on Jan 20, 2026

• [Model Runner V2] Support FLASHINFER_MLA backend (#32709)

  Show description for 9ab4388
  WoosukKwon

  authored
  9ab4388

  Copy full SHA for 9ab4388

• [Model Runner V2] Skip kernel launch for penalties & logit_bias (#32634)

  Show description for e9c83cd
  WoosukKwon

  authored
  e9c83cd

  Copy full SHA for e9c83cd

• [Model Runner V2] Decouple temperature from penalties (#32629)

  Show description for 6c01ffb
  WoosukKwon

  authored
  6c01ffb

  Copy full SHA for 6c01ffb

• [Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625)

  Show description for 7b7cdce
  WoosukKwon

  authored
  7b7cdce

  Copy full SHA for 7b7cdce

• [Model Runner V2] Initialized communication buffer for DP (#32624)

  Show description for 05dc4bf
  WoosukKwon

  authored
  05dc4bf

  Copy full SHA for 05dc4bf

Commits on Jan 19, 2026

• [Model Runner V2] Refactor `dummy_run` (#32533)

  Show description for 43fada5
  WoosukKwon

  authored
  43fada5

  Copy full SHA for 43fada5

• [Model Runner V2] Refactor `update_states` (#32562)

  Show description for 9a1f16d
  WoosukKwon

  authored
  9a1f16d

  Copy full SHA for 9a1f16d

• [Model Runner V2] Support VLM (#32546)

  Show description for bb1848c
  WoosukKwon

  authored
  bb1848c

  Copy full SHA for bb1848c

Commits on Jan 18, 2026

• [Model Runner V2] Minor optimization for eagle input processing (#32535)

  Show description for 963dc0b
  WoosukKwon

  authored
  963dc0b

  Copy full SHA for 963dc0b

• [Model Runner V2] Move mrope_positions buffer to MRopeState (#32532)

  Show description for 4147910
  WoosukKwon

  authored
  4147910

  Copy full SHA for 4147910

Commits on Jan 15, 2026

• [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348)

  Show description for 6218034
  WoosukKwon

  authored
  6218034

  Copy full SHA for 6218034

Commits on Jan 14, 2026

• [Model Runner V2] Refactor Sampler (#32245)

  Show description for 90c0836
  WoosukKwon

  authored
  90c0836

  Copy full SHA for 90c0836

Commits on Jan 12, 2026

• [Model Runner V2] Add support for M-RoPE (#32143)

  Show description for 0a7dd23
  WoosukKwon

  authored
  0a7dd23

  Copy full SHA for 0a7dd23

• [Model Runner V2] Minor refactor for logit_bias (#32209)

  Show description for dec2868
  WoosukKwon

  authored
  dec2868

  Copy full SHA for dec2868

• [Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163)

  Show description for ca81811
  WoosukKwon

  authored
  ca81811

  Copy full SHA for ca81811

• [Model Runner V2] Remove async barrier (#32083)

  Show description for 025a32f
  WoosukKwon

  authored
  025a32f

  Copy full SHA for 025a32f

Commits on Jan 11, 2026

• [Model Runner V2] Skip building deprecated fields in attn metadata (#32132)

  Show description for 19504ac
  WoosukKwon

  authored
  19504ac

  Copy full SHA for 19504ac

Commits on Jan 8, 2026

• [Model Runner V2] Simplify BlockTables with UVA (#31965)

  Show description for 7508243
  WoosukKwon

  authored
  7508243

  Copy full SHA for 7508243

Commits on Dec 9, 2025

• [Model Runner V2] Support num NaNs in logits (#30187)

  Show description for d471b2a
  WoosukKwon

  authored
  d471b2a

  Copy full SHA for d471b2a

• [Model Runner V2] Fix Triton warning on tl.where (#30355)

  Show description for 9e6562a
  WoosukKwon

  authored
  9e6562a

  Copy full SHA for 9e6562a

Commits on Dec 6, 2025

• [Model Runner V2] Support min-p sampling (#30171)

  Show description for a238cbd
  WoosukKwon

  authored
  a238cbd

  Copy full SHA for a238cbd

Commits on Dec 4, 2025

• [Model Runner V2] Implement get_num_sampled_and_rejected kernel (#30029)

  Show description for cc05055
  WoosukKwon

  authored
  cc05055

  Copy full SHA for cc05055

Commits on Nov 30, 2025

• [Model Runner V2] Use packed mask for prompt bin counts (#29756)

  Show description for ec38a73
  WoosukKwon

  authored
  ec38a73

  Copy full SHA for ec38a73

Commits on Nov 29, 2025

• [Model Runner V2] Fuse penalties and temperature into single kernel (#29720)

  Show description for f223ed4
  WoosukKwon

  authored
  f223ed4

  Copy full SHA for f223ed4

• [Model Runner V2] Add sample/ directory and reorganize files (#29719)

  Show description for 6afc0ff
  WoosukKwon

  authored
  6afc0ff

  Copy full SHA for 6afc0ff

• [Model Runner V2] Don't use UVA buffer for prefill_len (#29713)

  Show description for 4a80ad0
  WoosukKwon

  authored
  4a80ad0

  Copy full SHA for 4a80ad0