Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Jul 17, 2025

• [V0 deprecation] Remove V0 HPU backend (#21131)

  Show description for 4de7146
  WoosukKwon

  authored
  4de7146View commit details

  Copy full SHA for 4de7146

  View code at this pointBrowse repository at this point

Commits on Jun 3, 2025

• [Misc] Add SPDX-FileCopyrightText (#19100)

  Show description for 02f0c7b
  simon-mo

  authored
  02f0c7bView commit details

  Copy full SHA for 02f0c7b

  View code at this pointBrowse repository at this point

Commits on Mar 19, 2025

• [FEAT]Support reset prefix cache by specified device (#15003)

  maobaolong

  authored
  26dd972View commit details

  Copy full SHA for 26dd972

  View code at this pointBrowse repository at this point

Commits on Feb 4, 2025

• [Core] Improve hash collision avoidance in prefix caching (#12621)

  Show description for 73b35cc
  russellb

  authored
  73b35ccView commit details

  Copy full SHA for 73b35cc

  View code at this pointBrowse repository at this point

Commits on Feb 2, 2025

• [Misc] Add SPDX-License-Identifier headers to python source files (#12628)

  Show description for e489ad7
  russellb

  authored
  e489ad7View commit details

  Copy full SHA for e489ad7

  View code at this pointBrowse repository at this point

Commits on Jan 28, 2025

• Update `pre-commit` hooks (#12475)

  Show description for 823ab79
  hmellor

  authored
  823ab79View commit details

  Copy full SHA for 823ab79

  View code at this pointBrowse repository at this point

Commits on Jan 22, 2025

• [Core] Support `reset_prefix_cache` (#12284)

  comaniac

  authored
  7206ce4View commit details

  Copy full SHA for 7206ce4

  View code at this pointBrowse repository at this point

Commits on Jan 5, 2025

• fix: [doc] fix typo (#11751)

  Show description for eba1717
  RuixiangMa

  authored
  eba1717View commit details

  Copy full SHA for eba1717

  View code at this pointBrowse repository at this point

Commits on Dec 13, 2024

• [Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

  llsj14

  authored
  c31d4a5View commit details

  Copy full SHA for c31d4a5

  View code at this pointBrowse repository at this point

Commits on Nov 23, 2024

• Prefix Cache Aware Scheduling [1/n] (#10128)

  Show description for 4634a89
  rickyyx

  authored
  4634a89View commit details

  Copy full SHA for 4634a89

  View code at this pointBrowse repository at this point

Commits on Nov 6, 2024

• [Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

  Show description for a02a50e
  

  36 peopleauthored
  a02a50eView commit details

  Copy full SHA for a02a50e

  View code at this pointBrowse repository at this point

Commits on Oct 22, 2024

• [Core] Remove evictor_v1 (#9572)

  KuntaiDu

  authored
  ca30c3cView commit details

  Copy full SHA for ca30c3c

  View code at this pointBrowse repository at this point

Commits on Oct 17, 2024

• [Core] Deprecating block manager v1 and make block manager v2 default (#8704)

  Show description for 81ede99
  KuntaiDu

  authored
  81ede99View commit details

  Copy full SHA for 81ede99

  View code at this pointBrowse repository at this point

Commits on Oct 7, 2024

• [BugFix][Core] Fix BlockManagerV2 when Encoder Input is None (#9103)

  sroy745

  authored
  c8f26bbView commit details

  Copy full SHA for c8f26bb

  View code at this pointBrowse repository at this point

Commits on Sep 29, 2024

• [Bugfix] Block manager v2 with preemption and lookahead slots (#8824)

  sroy745

  authored
  5bf8789View commit details

  Copy full SHA for 5bf8789

  View code at this pointBrowse repository at this point

Commits on Sep 27, 2024

• [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378)

  Show description for c2ec430
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  c2ec430View commit details

  Copy full SHA for c2ec430

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2024

• [CI/Build] Update Ruff version (#8469)

  Show description for 9d104b5
  

  aarnphm

  and

  DarkLight1337

  authored
  9d104b5View commit details

  Copy full SHA for 9d104b5

  View code at this pointBrowse repository at this point

Commits on Aug 27, 2024

• [mypy] Enable mypy type checking for `vllm/core` (#7229)

  jberkhahn

  authored
  9c71c97View commit details

  Copy full SHA for 9c71c97

  View code at this pointBrowse repository at this point

Commits on Aug 26, 2024

• [Performance][BlockManagerV2] Mark prefix cache block as computed after schedule (#7822)

  comaniac

  authored
  2deb029View commit details

  Copy full SHA for 2deb029

  View code at this pointBrowse repository at this point

Commits on Aug 19, 2024

• [MISC] Add prefix cache hit rate to metrics (#7606)

  comaniac

  authored
  3ac50b4View commit details

  Copy full SHA for 3ac50b4

  View code at this pointBrowse repository at this point

Commits on Aug 9, 2024

• [Core] Fix edge case in chunked prefill + block manager v2 (#7380)

  cadedaniel

  authored
  baa2402View commit details

  Copy full SHA for baa2402

  View code at this pointBrowse repository at this point

Commits on Aug 8, 2024

• [Bugfix][fast] Fix the get_num_blocks_touched logic (#6849)

  zachzzc

  authored
  782e53aView commit details

  Copy full SHA for 782e53a

  View code at this pointBrowse repository at this point

Commits on Aug 6, 2024

• [Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)

  Show description for fd95e02
  

  3 peopleauthored
  fd95e02View commit details

  Copy full SHA for fd95e02

  View code at this pointBrowse repository at this point

Commits on Jul 19, 2024

• [Misc] Small perf improvements (#6520)

  Yard1

  authored
  9ed82e7View commit details

  Copy full SHA for 9ed82e7

  View code at this pointBrowse repository at this point

Commits on Jul 2, 2024

• [Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) (#5602)

  alexm-redhat

  authored
  3476ed0View commit details

  Copy full SHA for 3476ed0

  View code at this pointBrowse repository at this point

Commits on Jun 15, 2024

• [mypy] Enable type checking for test directory (#5017)

  DarkLight1337

  authored
  0e9164bView commit details

  Copy full SHA for 0e9164b

  View code at this pointBrowse repository at this point

• [Core][Bugfix]: fix prefix caching for blockv2 (#5364)

  Show description for 1b8a0d7
  

  leiwen83

  and

  wenlei03

  authored
  1b8a0d7View commit details

  Copy full SHA for 1b8a0d7

  View code at this pointBrowse repository at this point

Commits on Jun 3, 2024

• [Misc]: Implement CPU/GPU swapping in BlockManagerV2 (#3834)

  Kaiyang-Chen

  authored
  10c38e3View commit details

  Copy full SHA for 10c38e3

  View code at this pointBrowse repository at this point

Commits on May 29, 2024

• [Core] Cross-attention KV caching and memory-management (towards eventual encoder/decoder model support) (#4837)

  afeldman-nm

  authored
  4238bc8View commit details

  Copy full SHA for 4238bc8

  View code at this pointBrowse repository at this point

Commits on May 28, 2024

• [Core] Sliding window for block manager v2 (#4545)

  Show description for d4f3985
  

  mmoskal

  and

  Ruth Evans

  authored
  d4f3985View commit details

  Copy full SHA for d4f3985

  View code at this pointBrowse repository at this point

Commits on May 24, 2024

• [Core][Bugfix]: fix prefix caching for blockv2 (#4764)

  Show description for e64fde4
  

  leiwen83

  and

  wenlei03

  authored
  e64fde4View commit details

  Copy full SHA for e64fde4

  View code at this pointBrowse repository at this point

Commits on May 7, 2024

• [Core][Optimization] change copy-on-write from dict[int, list] to list (#4648)

  youkaichao

  authored
  469f85cView commit details

  Copy full SHA for 469f85c

  View code at this pointBrowse repository at this point

Commits on May 2, 2024

• [Core] Ignore infeasible swap requests. (#4557)

  rkooo567

  authored
  0f8a914View commit details

  Copy full SHA for 0f8a914

  View code at this pointBrowse repository at this point

• [mypy][6/N] Fix all the core subdirectory typing (#4450)

  Show description for cf8cac8
  

  rkooo567

  and

  cadedaniel

  authored
  cf8cac8View commit details

  Copy full SHA for cf8cac8

  View code at this pointBrowse repository at this point

Commits on May 1, 2024

• [Core] Enable prefix caching with block manager v2 enabled (#4142)

  Show description for 24750f4
  

  3 peopleauthored
  24750f4View commit details

  Copy full SHA for 24750f4

  View code at this pointBrowse repository at this point