Commits

Branch selector

 main

User selector

benchislett

All time

Commit History

Commits on Apr 24, 2026

• [Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662)

  Show description for 626daa2
  

  benchislett

  and

  gemini-code-assist[bot]

  authored
  626daa2

  Copy full SHA for 626daa2

Commits on Apr 15, 2026

• [Bugfix][Perf] Indexer upcast WK to BF16 for fusion (#38928)

  Show description for ac3dac5
  benchislett

  authored
  ac3dac5

  Copy full SHA for ac3dac5

Commits on Apr 11, 2026

• Revert "Add nightly b200 test for spec decode eagle correctness (#38577)" (#39512)

  Show description for af661a1
  benchislett

  authored
  af661a1

  Copy full SHA for af661a1

Commits on Apr 9, 2026

• [Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315)

  Show description for 8332078
  

  benchislett

  and

  gemini-code-assist[bot]

  authored
  8332078

  Copy full SHA for 8332078

Commits on Apr 2, 2026

• [Perf] DSV3.2 Indexer Fused Weights Projection (#38684)

  Show description for 5f96f9a
  benchislett

  authored
  5f96f9a

  Copy full SHA for 5f96f9a

Commits on Mar 30, 2026

• [Feat][Spec Decode] DFlash (#36847)

  Show description for 494636b
  benchislett

  authored
  494636b

  Copy full SHA for 494636b

Commits on Mar 17, 2026

• [Bugfix] Fix DP MTP Dummy Run (#35243)

  Show description for f63ed7b
  benchislett

  authored
  f63ed7b

  Copy full SHA for f63ed7b

• [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447)

  benchislett

  authored
  8a68046

  Copy full SHA for 8a68046

Commits on Mar 13, 2026

• [Refactor] Consolidate SupportsEagle (#36063)

  Show description for 8b34630
  benchislett

  authored
  8b34630

  Copy full SHA for 8b34630

Commits on Mar 11, 2026

• [DSV3.2][MTP] Optimize Indexer MTP handling (#36723)

  Show description for 9040cd4
  benchislett

  authored
  9040cd4

  Copy full SHA for 9040cd4

Commits on Mar 5, 2026

• [Bugfix] Fix block_size for hybrid model MTP (#36036)

  Show description for 57c629e
  benchislett

  authored
  57c629e

  Copy full SHA for 57c629e

Commits on Feb 25, 2026

• [Tests] Add GSM8k check to SpecDec E2E tests (#34772)

  Show description for ee59a7c
  benchislett

  authored
  ee59a7c

  Copy full SHA for ee59a7c

Commits on Feb 24, 2026

• [Bug][DSV3.2] Always prepare metadata for DeepGEMM Sparse Attention (#35075)

  Show description for 9fa5b25
  benchislett

  authored
  9fa5b25

  Copy full SHA for 9fa5b25

• [Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726)

  Show description for f5972a8
  

  4 peopleauthored
  f5972a8

  Copy full SHA for f5972a8

Commits on Feb 22, 2026

• [Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

  Show description for 682566b
  benchislett

  authored
  682566b

  Copy full SHA for 682566b

Commits on Feb 5, 2026

• [Spec Decode] Unified Parallel Drafting (#32887)

  Show description for af3162d
  benchislett

  authored
  af3162d

  Copy full SHA for af3162d

Commits on Jan 6, 2026

• [Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821)

  Show description for f7008ce
  

  benchislett

  and

  njhill

  authored
  f7008ce

  Copy full SHA for f7008ce

Commits on Jan 2, 2026

• [Bugfix] Fix block size used in EAGLE slot mapping (#31540)

  Show description for ea53ca5
  benchislett

  authored
  ea53ca5

  Copy full SHA for ea53ca5

Commits on Dec 22, 2025

• [Perf] Remove blocking copy in GDN Attention (#31167)

  Show description for 85aff45
  benchislett

  authored
  85aff45

  Copy full SHA for 85aff45

Commits on Dec 18, 2025

• [Cleanup] Refactor FlashInferMetadataBuilder (#29128)

  Show description for d6b3d39
  

  benchislett

  and

  LucasWilkinson

  authored
  d6b3d39

  Copy full SHA for d6b3d39

Commits on Dec 9, 2025

• [Cleanup] Refactor profiling env vars into a CLI config (#29912)

  Show description for e858bfe
  

  3 peopleauthored
  e858bfe

  Copy full SHA for e858bfe

Commits on Nov 28, 2025

• [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597)

  Show description for 1986de1
  benchislett

  authored
  1986de1

  Copy full SHA for 1986de1

Commits on Nov 20, 2025

• [Feat] Iteration-level profiling for Torch and CUDA profiler (#28987)

  Show description for fcbcba6
  

  benchislett

  and

  gemini-code-assist[bot]

  authored
  fcbcba6

  Copy full SHA for fcbcba6

Commits on Nov 14, 2025

• [Bugfix] Fix ChunkedLocalAttention CUDA Graph setting (#28739)

  Show description for bf3ffb6
  benchislett

  authored
  bf3ffb6

  Copy full SHA for bf3ffb6

Commits on Nov 12, 2025

• [Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)

  Show description for 3044195
  benchislett

  authored
  3044195

  Copy full SHA for 3044195

Commits on Nov 8, 2025

• [Feat] Drop-in Torch CUDA Profiler (#27841)

  Show description for 975676d
  benchislett

  authored
  975676d

  Copy full SHA for 975676d

Commits on Nov 7, 2025

• [Bugfix] Fix and add tests for GptOss reasoning parser (#28000)

  Show description for 1890321
  benchislett

  authored
  1890321

  Copy full SHA for 1890321

Commits on Oct 21, 2025

• [Bugfix] skip cuda graph for drafter when running with eager (#26821)

  Show description for 1974880
  benchislett

  authored
  1974880

  Copy full SHA for 1974880

• [Bugfix] Fix broken MTP weight loading for FP8 KV Scales (#27227)

  Show description for f381cf2
  benchislett

  authored
  f381cf2

  Copy full SHA for f381cf2

Commits on Oct 9, 2025

• [Bugfix] Fix CUDA graph selection bug in FlashInfer at high concurrency (#26499)

  Show description for 6e783bc
  benchislett

  authored
  6e783bc

  Copy full SHA for 6e783bc

Commits on Oct 7, 2025

• [Bugfix] Fix MTP+FlashInfer crash when trtllm kernels are available but disabled (#26361)

  Show description for caf8b1c
  

  benchislett

  and

  gemini-code-assist[bot]

  authored
  caf8b1c

  Copy full SHA for caf8b1c

• [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984)

  Show description for 3d1f676
  benchislett

  authored
  3d1f676

  Copy full SHA for 3d1f676

Commits on Oct 6, 2025

• [Perf] Add decode full-graph support to FlashInfer-MLA backend (#26313)

  Show description for f77df94
  benchislett

  authored
  f77df94

  Copy full SHA for f77df94

• [Bugfix] Allow skipping MoE in NVFP4 (fix for MTP) (#25987)

  Show description for 2161efe
  benchislett

  authored
  2161efe

  Copy full SHA for 2161efe

Commits on Oct 3, 2025

• [Bug]: Limit num_reqs in dummy_run when max_num_seqs is small (#26144)

  Show description for 6a7796e
  benchislett

  authored
  6a7796e

  Copy full SHA for 6a7796e