Commits

Branch selector

 main

User selector

orozery

All time

Commit History

Commits on Apr 23, 2026

• [kv_offload+HMA][10/N]: Support load with multiple KV groups (#39402)

  Show description for 5ef33ab
  orozery

  authored
  5ef33ab

  Copy full SHA for 5ef33ab

Commits on Apr 22, 2026

• [kv_offload+HMA][8/N]: Support multi-group worker transfer (#38453)

  Show description for aad88f8
  

  orozery

  and

  mergify[bot]

  authored
  aad88f8

  Copy full SHA for aad88f8

Commits on Apr 20, 2026

• [kv_offload+HMA][4/N]: Support sliding window lookup (#36645)

  Show description for f774ba0
  

  orozery

  and

  NickLucche

  authored
  f774ba0

  Copy full SHA for f774ba0

Commits on Apr 17, 2026

• [kv_offload]: Fix num CPU blocks for UniformTypeKVCacheSpecs (#39617)

  Show description for 79a5b63
  orozery

  authored
  79a5b63

  Copy full SHA for 79a5b63

Commits on Apr 15, 2026

• [kv_offload+HMA][3/N]: Remove block_size from KVEvents (#36644)

  Show description for 235e1f9
  orozery

  authored
  235e1f9

  Copy full SHA for 235e1f9

Commits on Apr 8, 2026

• [kv_offload+HMA][5/N]: Track group block hashes and block IDs (#37109)

  Show description for 512c5eb
  orozery

  authored
  512c5eb

  Copy full SHA for 512c5eb

Commits on Mar 27, 2026

• [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853)

  Show description for 7cc302d
  orozery

  authored
  7cc302d

  Copy full SHA for 7cc302d

Commits on Mar 18, 2026

• [kv_offload+HMA][2/N]: Support multiple KV groups in GPULoadStoreSpec (#36642)

  Show description for 5dd8df0
  orozery

  authored
  5dd8df0

  Copy full SHA for 5dd8df0

• [kv_offload+HMA][6/N]: Split offloading_connector.py (#37405)

  Show description for 525f2ee
  orozery

  authored
  525f2ee

  Copy full SHA for 525f2ee

• [kv_offload+HMA][0/N]: Support block-level preemption handling (#34805)

  Show description for fcf0687
  

  orozery

  and

  NickLucche

  authored
  fcf0687

  Copy full SHA for fcf0687

Commits on Mar 13, 2026

• [kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610)

  Show description for cfaf466
  orozery

  authored
  cfaf466

  Copy full SHA for cfaf466

Commits on Mar 11, 2026

• [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881)

  Show description for 7ee5d50
  

  orozery

  and

  NickLucche

  authored
  7ee5d50

  Copy full SHA for 7ee5d50

• [KVConnector] Support worker -> scheduler metadata (#31964)

  Show description for a1a3523
  

  orozery

  and

  NickLucche

  authored
  a1a3523

  Copy full SHA for a1a3523

Commits on Mar 5, 2026

• [KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616)

  Show description for 612e772
  orozery

  authored
  612e772

  Copy full SHA for 612e772

Commits on Feb 26, 2026

• [BugFix][kv_offload]: Fix kernel block size detection (#35125)

  Show description for f2ad952
  orozery

  authored
  f2ad952

  Copy full SHA for f2ad952

Commits on Feb 4, 2026

• [KV Connector][BugFix] scheduler: Delay freeing blocks of aborted async loads (#32255)

  Show description for 8e32690
  orozery

  authored
  8e32690

  Copy full SHA for 8e32690

Commits on Jan 29, 2026

• [Misc] Add orozery to CODEOWNERS (core, kv_transfer, kv_offload) (#33227)

  Show description for a663b21
  orozery

  authored
  a663b21

  Copy full SHA for a663b21

Commits on Jan 28, 2026

• Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241)

  Show description for 2e8de86
  

  orozery

  and

  khluu

  authored
  2e8de86

  Copy full SHA for 2e8de86

Commits on Jan 22, 2026

• OffloadingConnector: Support kernel_block_size != block_size (#30692)

  Show description for 421012b
  orozery

  authored
  421012b

  Copy full SHA for 421012b

Commits on Jan 21, 2026

• OffloadingConnector: Prevent redundant loads (#29087)

  Show description for 7013e9a
  orozery

  authored
  7013e9a

  Copy full SHA for 7013e9a

Commits on Jan 12, 2026

• [BugFix] scheduler: Fix ordering preserving of skipped requests (#32173)

  Show description for 2be765b
  orozery

  authored
  2be765b

  Copy full SHA for 2be765b

• OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

  Show description for 9cddbdb
  orozery

  authored
  9cddbdb

  Copy full SHA for 9cddbdb

Commits on Jan 11, 2026

• [KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870)

  Show description for 4c16ba6
  orozery

  authored
  4c16ba6

  Copy full SHA for 4c16ba6

Commits on Jan 10, 2026

• [BugFix] Wait for compute before offloading KV to CPU (#31341)

  Show description for 2a4dbe2
  orozery

  authored
  2a4dbe2

  Copy full SHA for 2a4dbe2

• [BugFix] scheduler: Fix resuming of preempted requests after async load (#31583)

  Show description for 0285997
  orozery

  authored
  0285997

  Copy full SHA for 0285997

Commits on Jan 5, 2026

• Triton Attention: Support cross-layers blocks (#30687)

  Show description for d8e38d4
  orozery

  authored
  d8e38d4

  Copy full SHA for d8e38d4

Commits on Dec 14, 2025

• CPU KV Offloading: Use more CUDA streams (#29013)

  Show description for 174e39e
  orozery

  authored
  174e39e

  Copy full SHA for 174e39e

Commits on Dec 9, 2025

• kv_transfer: Rename the shared storage connectors (#30201)

  Show description for 4c6fd25
  orozery

  authored
  4c6fd25

  Copy full SHA for 4c6fd25

Commits on Nov 20, 2025

• [KVConnector][Core] Support cross-layer KV blocks (#27743)

  Show description for 6474647
  orozery

  authored
  6474647

  Copy full SHA for 6474647

• [BugFix] kv_offloading: Fix bug in loading of partial cpu blocks (#28951)

  Show description for c0c2dd1
  

  orozery

  and

  DarkLight1337

  authored
  c0c2dd1

  Copy full SHA for c0c2dd1

Commits on Oct 28, 2025

• [Core] Scheduler: Publish connector events after output (#25875)

  Show description for 111faf1
  orozery

  authored
  111faf1

  Copy full SHA for 111faf1

Commits on Sep 30, 2025

• OffloadingConnector: Fix GPU block tracking bug (#25856)

  Show description for cfd302d
  orozery

  authored
  cfd302d

  Copy full SHA for cfd302d

Commits on Sep 22, 2025

• [KV offload][5/N] Add `CPUOffloadingSpec` (#24251)

  Show description for 8db2939
  orozery

  authored
  8db2939

  Copy full SHA for 8db2939

Commits on Sep 19, 2025

• [KV offload][4/N] Offloading KV connector (#22595)

  Show description for c59a0ec
  orozery

  authored
  c59a0ec

  Copy full SHA for c59a0ec

• [KV offload][3/N] Add worker-side CPU support (#21448)

  Show description for 7ac67ea
  orozery

  authored
  7ac67ea

  Copy full SHA for 7ac67ea