Commits

Branch selector

 main

User selector

WoosukKwon

All time

Commit History

Commits on Apr 6, 2026

• [MRV2] Fix hanging issue with DeepSeek V3.2 by setting `skip_attn=False` (#39098)

  Show description for f186cfe
  WoosukKwon

  authored
  f186cfe

  Copy full SHA for f186cfe

Commits on Mar 26, 2026

• Relocate Encoder CUDA graph manager (#38116)

  Show description for 144030c
  

  WoosukKwon

  and

  njhill

  authored
  144030c

  Copy full SHA for 144030c

Commits on Mar 24, 2026

• [MRV2] Fix for DS v3.2 (#38030)

  Show description for 4b53740
  WoosukKwon

  authored
  4b53740

  Copy full SHA for 4b53740

Commits on Mar 23, 2026

• [MRV2] Consider spec decoding in warmup (#37812)

  Show description for ffb5b32
  

  WoosukKwon

  and

  njhill

  authored
  ffb5b32

  Copy full SHA for ffb5b32

Commits on Mar 22, 2026

• [MRV2] Enable PP CUDA graph test (#37830)

  Show description for 43877a6
  WoosukKwon

  authored
  43877a6

  Copy full SHA for 43877a6

• [MRV2] Use FP64 for Gumbel noise (#37798)

  Show description for a5e9d51
  WoosukKwon

  authored
  a5e9d51

  Copy full SHA for a5e9d51

• [MRV2] Skip hidden states allocation for PW CUDA graphs (#37818)

  Show description for ce9b1d7
  WoosukKwon

  authored
  ce9b1d7

  Copy full SHA for ce9b1d7

Commits on Mar 20, 2026

• [MRV2] Avoid recompilation of _gather_block_tables_kernel (#37645)

  Show description for e80cfe5
  WoosukKwon

  authored
  e80cfe5

  Copy full SHA for e80cfe5

Commits on Mar 19, 2026

• [MRV2] Use fp32 for draft logits (#37526)

  Show description for 40b8363
  WoosukKwon

  authored
  40b8363

  Copy full SHA for 40b8363

Commits on Mar 18, 2026

• [LoRA][BugFix] Fix skipped LoRA adapters for Mistral3 (#36928)

  Show description for 5bc1da1
  WoosukKwon

  authored
  5bc1da1

  Copy full SHA for 5bc1da1

Commits on Mar 16, 2026

• [Model Runner V2] Fix processed logits in sample() (#37144)

  Show description for 96efb91
  WoosukKwon

  authored
  96efb91

  Copy full SHA for 96efb91

Commits on Mar 12, 2026

• [Model Runner V2] Do not initialize sampler for non-last PP ranks (#36824)

  Show description for 2f8b4ce
  WoosukKwon

  authored
  2f8b4ce

  Copy full SHA for 2f8b4ce

Commits on Mar 11, 2026

• [Model Runner V2] Add WhisperModelState [6/N] (#35790)

  Show description for 55eed6b
  WoosukKwon

  authored
  55eed6b

  Copy full SHA for 55eed6b

• [Model Runner V2] Remove unused warmup_for_prefill method (#36762)

  Show description for 8ccbcda
  WoosukKwon

  authored
  8ccbcda

  Copy full SHA for 8ccbcda

Commits on Mar 10, 2026

• [Minor] Enhance error message for TRTLLM decode uniformity check (#36609)

  Show description for 195d1ca
  WoosukKwon

  authored
  195d1ca

  Copy full SHA for 195d1ca

• [Model Runner V2] Use unpadded num_tokens for PW CUDA graph attn metadata (#36626)

  Show description for f088a83
  WoosukKwon

  authored
  f088a83

  Copy full SHA for f088a83

• [BugFix] Remove incorrect assert in split_decodes_and_prefills (#36553)

  Show description for 006aea1
  WoosukKwon

  authored
  006aea1

  Copy full SHA for 006aea1

Commits on Mar 9, 2026

• [Model Runner V2] Add model_state inputs to CUDA graph capture (#36544)

  Show description for 2a194dd
  WoosukKwon

  authored
  2a194dd

  Copy full SHA for 2a194dd

• [Model Runner V2] Use NamedTuple for `execute_model_state` (#35930)

  Show description for 10a5f4d
  WoosukKwon

  authored
  10a5f4d

  Copy full SHA for 10a5f4d

• [Model Runner V2] Add dummy profile_cudagraph_memory API (#36520)

  Show description for 6e956d9
  WoosukKwon

  authored
  6e956d9

  Copy full SHA for 6e956d9

Commits on Mar 3, 2026

• [Model Runner V2] Fix inputs_embeds=None bug for MM models (#35917)

  Show description for 467886a
  WoosukKwon

  authored
  467886a

  Copy full SHA for 467886a

• [Model Runner V2] Use ModelState.prepare_attn() for cuda graph capture [5/N] (#35774)

  Show description for a0a5178
  WoosukKwon

  authored
  a0a5178

  Copy full SHA for a0a5178

• [Docs][Model Runner V2] Add Design Docs (#35819)

  Show description for 4f85bae
  WoosukKwon

  authored
  4f85bae

  Copy full SHA for 4f85bae

Commits on Mar 1, 2026

• [Model Runner V2] Use block table apis for capture inputs (#35671)

  Show description for 72f4d16
  WoosukKwon

  authored
  72f4d16

  Copy full SHA for 72f4d16

• [Model Runner V2] Minor refactoring for EncoderRunner (#35628)

  Show description for da543d1
  WoosukKwon

  authored
  da543d1

  Copy full SHA for da543d1

Commits on Feb 28, 2026

• [Model Runner V2] Add ModelStateInterface [4/N] (#35621)

  Show description for e3eb146
  WoosukKwon

  authored
  e3eb146

  Copy full SHA for e3eb146

• [Model Runner V2] Move MM encoder to Model States [3/N] (#35564)

  Show description for 1a014a0
  WoosukKwon

  authored
  1a014a0

  Copy full SHA for 1a014a0

• [Model Runner V2] Support pooling models (#35120)

  Show description for 86ac7bc
  WoosukKwon

  authored
  86ac7bc

  Copy full SHA for 86ac7bc

Commits on Feb 26, 2026

• [Model Runner V2] Prepare attn metadata in ModelState [2/N] (#35383)

  Show description for 3d66502
  WoosukKwon

  authored
  3d66502

  Copy full SHA for 3d66502

• [Model Runner V2] Add model states [1/N] (#35350)

  Show description for c66aa48
  WoosukKwon

  authored
  c66aa48

  Copy full SHA for c66aa48

• [Model Runner V2] Add coding style guide (#35325)

  Show description for 13025e7
  WoosukKwon

  authored
  13025e7

  Copy full SHA for 13025e7

Commits on Feb 23, 2026

• [Model Runner V2] Remove propose_draft method (#35070)

  Show description for c645e9a
  WoosukKwon

  authored
  c645e9a

  Copy full SHA for c645e9a

Commits on Feb 22, 2026

• [Model Runner V2] Enable CUDA graph for Eagle3 (#35040)

  Show description for 2cbf965
  WoosukKwon

  authored
  2cbf965

  Copy full SHA for 2cbf965

• [Model Runner V2] Support attention group (#35036)

  Show description for b71fbd0
  WoosukKwon

  authored
  b71fbd0

  Copy full SHA for b71fbd0

Commits on Feb 21, 2026

• [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029)

  Show description for a4047d4
  WoosukKwon

  authored
  a4047d4

  Copy full SHA for a4047d4