Commits

Branch selector

master

User selector

All users

All time

Commit history

Commits on Aug 10, 2026

• Add fused asynchronous MTP decoding with overlap scheduling and CUDA graph support (#255)

  Show description for 17094c8
  gty111

  authored
  17094c8View commit details

  Copy full SHA for 17094c8

  Browse repository at this point

Commits on Aug 9, 2026

• Pin torch+cu129 (#254)

  gty111

  authored
  d880746View commit details

  Copy full SHA for d880746

  Browse repository at this point

• Fix MTP schedule (#253)

  gty111

  authored
  37cf0cfView commit details

  Copy full SHA for 37cf0cf

  Browse repository at this point

Commits on Aug 1, 2026

• Support Qwen3.5 mtp (#252)

  Show description for d1b2b1b
  gty111

  authored
  d1b2b1bView commit details

  Copy full SHA for d1b2b1b

  Browse repository at this point

Commits on Jul 31, 2026

• Add restriction for nv cutlass dsl package (#251)

  gty111

  authored
  5b0fe72View commit details

  Copy full SHA for 5b0fe72

  Browse repository at this point

Commits on Jul 27, 2026

• Support DPSK V3.2 MTP (#250)

  gty111

  authored
  7f95af8View commit details

  Copy full SHA for 7f95af8

  Browse repository at this point

Commits on Jul 20, 2026

• Support Deepseek v32 encode (#249)

  gty111

  authored
  bc91d98View commit details

  Copy full SHA for bc91d98

  Browse repository at this point

Commits on Jul 19, 2026

• Support Deepseek v32 (#248)

  Show description for ce3e2f1
  gty111

  authored
  ce3e2f1View commit details

  Copy full SHA for ce3e2f1

  Browse repository at this point

• Add contributing.md (#247)

  gty111

  authored
  43fce14View commit details

  Copy full SHA for 43fce14

  Browse repository at this point

• Bump up to v0.0.7 (#246)

  gty111

  authored
  23409b3View commit details

  Copy full SHA for 23409b3

  Browse repository at this point

Commits on Jul 17, 2026

• Fix pp gdn (#245)

  Show description for e8dedd1
  gty111

  authored
  e8dedd1View commit details

  Copy full SHA for e8dedd1

  Browse repository at this point

• Support logprobs return (#244)

  Show description for 662e48b
  gty111

  authored
  662e48bView commit details

  Copy full SHA for 662e48b

  Browse repository at this point

Commits on Jul 5, 2026

• Support DP ATTN (#243)

  Show description for b9e7680
  gty111

  authored
  b9e7680View commit details

  Copy full SHA for b9e7680

  Browse repository at this point

Commits on Jul 2, 2026

• Fix tool call eval and clean up weights load (#242)

  gty111

  authored
  5619474View commit details

  Copy full SHA for 5619474

  Browse repository at this point

Commits on Jul 1, 2026

• Fix None and add info for error (#241)

  gty111

  authored
  e5cbe59View commit details

  Copy full SHA for e5cbe59

  Browse repository at this point

• Opt model loader (#240)

  gty111

  authored
  26ba2bcView commit details

  Copy full SHA for 26ba2bc

  Browse repository at this point

• Support deepgemm and flashinfer for fp8 (#239)

  Show description for 2313d89
  gty111

  authored
  2313d89View commit details

  Copy full SHA for 2313d89

  Browse repository at this point

• Add bfcl benchmark (#237)

  gty111

  authored
  91842b7View commit details

  Copy full SHA for 91842b7

  Browse repository at this point

• Fix qwen3 tool call (#238)

  gty111

  authored
  3578027View commit details

  Copy full SHA for 3578027

  Browse repository at this point

Commits on Jun 30, 2026

• Fix qwen fp8 and tool call (#236)

  gty111

  authored
  6e7cf81View commit details

  Copy full SHA for 6e7cf81

  Browse repository at this point

Commits on Jun 18, 2026

• Support tool call and tool parse (#235)

  gty111

  authored
  ef9ae9aView commit details

  Copy full SHA for ef9ae9a

  Browse repository at this point

• Update chat client (#234)

  gty111

  authored
  a7ff114View commit details

  Copy full SHA for a7ff114

  Browse repository at this point

Commits on Jun 17, 2026

• Support chat kwargs (#233)

  gty111

  authored
  934ecbdView commit details

  Copy full SHA for 934ecbd

  Browse repository at this point

• Support K2.5/6/7 (#224)

  Show description for 167eedf
  gty111

  authored
  167eedfView commit details

  Copy full SHA for 167eedf

  Browse repository at this point

• Refactor schedule (#232)

  Show description for c7dc791
  gty111

  authored
  c7dc791View commit details

  Copy full SHA for c7dc791

  Browse repository at this point

• Fix prompt len (#231)

  gty111

  authored
  8805076View commit details

  Copy full SHA for 8805076

  Browse repository at this point

Commits on Jun 16, 2026

• Add info in openai response (#230)

  gty111

  authored
  9b4226eView commit details

  Copy full SHA for 9b4226e

  Browse repository at this point

Commits on Jun 15, 2026

• Refactor weights loader (#229)

  gty111

  authored
  25a81bdView commit details

  Copy full SHA for 25a81bd

  Browse repository at this point

• Make span process async launch (#228)

  gty111

  authored
  940a030View commit details

  Copy full SHA for 940a030

  Browse repository at this point

• Fix scheduler log (#227)

  gty111

  authored
  f14e2fdView commit details

  Copy full SHA for f14e2fd

  Browse repository at this point

• Support flash mla (#226)

  gty111

  authored
  7a32f79View commit details

  Copy full SHA for 7a32f79

  Browse repository at this point

• Add mmlu script (#225)

  gty111

  authored
  842acfaView commit details

  Copy full SHA for 842acfa

  Browse repository at this point

Commits on Jun 8, 2026

• Opt rep (#223)

  gty111

  authored
  75aba58View commit details

  Copy full SHA for 75aba58

  Browse repository at this point

• Support persistent repetition penalty build (#222)

  gty111

  authored
  e439974View commit details

  Copy full SHA for e439974

  Browse repository at this point

• Update default value (#221)

  gty111

  authored
  5cb5350View commit details

  Copy full SHA for 5cb5350

  Browse repository at this point