Commits

Branch selector

main

User selector

All users

All time

Commit history

Commits on Dec 22, 2024

• [cd][release] fix race conditions (#11407)

  Show description for 72d9c31
  youkaichao

  authored
  72d9c31

  Copy full SHA for 72d9c31

• [cd][release] add pypi index for every commit and nightly build (#11404)

  Show description for 4a91397
  

  youkaichao

  and

  ywang96

  authored
  4a91397

  Copy full SHA for 4a91397

• [CI] Fix flaky entrypoint tests (#11403)

  Show description for 29c7489
  ywang96

  authored
  29c7489

  Copy full SHA for 29c7489

Commits on Dec 21, 2024

• [Bugfix] Fix issues for `Pixtral-Large-Instruct-2411` (#11393)

  Show description for c2d1b07
  

  ywang96

  and

  ywang96

  authored
  c2d1b07

  Copy full SHA for c2d1b07

• [V1] Make AsyncLLMEngine v1-v0 opaque (#11383)

  Show description for 584f0ae
  rickyyx

  authored
  584f0ae

  Copy full SHA for 584f0ae

• [Bugfix] update should_ignore_layer (#11354)

  Show description for 51ff216
  

  George

  authored
  51ff216

  Copy full SHA for 51ff216

• [V1][Bugfix] Skip hashing empty or None mm_data (#11386)

  Show description for dd2b563
  WoosukKwon

  authored
  dd2b563

  Copy full SHA for dd2b563

Commits on Dec 20, 2024

• Add ray[default] to wget to run distributed inference out of box (#11265)

  Show description for 47a0b61
  Jeffwan

  authored
  47a0b61

  Copy full SHA for 47a0b61

• [doc] explain nccl requirements for rlhf (#11381)

  Show description for 5d2248d
  youkaichao

  authored
  5d2248d

  Copy full SHA for 5d2248d

• [Bugfix] Don't log OpenAI field aliases as ignored (#11378)

  Show description for d573aea
  mgoin

  authored
  d573aea

  Copy full SHA for d573aea

• [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

  Show description for 995f562
  omer-dayan

  authored
  995f562

  Copy full SHA for 995f562

• [CI/Build] fix pre-compiled wheel install for exact tag (#11373)

  Show description for 7c7aa37
  dtrifiro

  authored
  7c7aa37

  Copy full SHA for 7c7aa37

• [V1] Fix profiling for models with merged input processor (#11370)

  Show description for 04139ad
  ywang96

  authored
  04139ad

  Copy full SHA for 04139ad

• [doc] backward compatibility for 0.6.4 (#11359)

  Show description for 1ecc645
  youkaichao

  authored
  1ecc645

  Copy full SHA for 1ecc645

• [misc] add early error message for custom ops (#11355)

  Show description for c954f21
  youkaichao

  authored
  c954f21

  Copy full SHA for c954f21

• [Bugfix] Fix spec decoding when seed is none in a batch (#10863)

  Show description for 86c2d8f
  wallashss

  authored
  86c2d8f

  Copy full SHA for 86c2d8f

• [Misc] Add tqdm progress bar during graph capture (#11349)

  Show description for b880ffb
  mgoin

  authored
  b880ffb

  Copy full SHA for b880ffb

• [ci][gh200] dockerfile clean up (#11351)

  Show description for 7801f56
  

  3 peopleauthored
  7801f56

  Copy full SHA for 7801f56

• [Bugfix][Hardware][POWERPC] Fix auto dtype failure in case of POWER10 (#11331)

  Show description for 48edab8
  Akashcodes732

  authored
  48edab8

  Copy full SHA for 48edab8

Commits on Dec 19, 2024

• [CI] Adding CPU docker pipeline (#11261)

  Show description for a985f7a
  

  zhouyuan

  and

  khluu

  authored
  a985f7a

  Copy full SHA for a985f7a

• [Misc] Remove unused vllm/block.py (#11336)

  Ghjk94522

  authored
  e461c26

  Copy full SHA for e461c26

• [Bugfix] Fix broken CPU compressed-tensors test (#11338)

  Show description for 276738c
  Isotr0py

  authored
  276738c

  Copy full SHA for 276738c

• [Misc] Clean up and consolidate LRUCache (#11339)

  Show description for cdf22af
  DarkLight1337

  authored
  cdf22af

  Copy full SHA for cdf22af

• [Model] Refactor Qwen2-VL to use merged multimodal processor (#11258)

  Show description for e24113a
  

  Isotr0py

  and

  DarkLight1337

  authored
  e24113a

  Copy full SHA for e24113a

• [V1] Fix multimodal profiling for `Molmo` (#11325)

  Show description for 7379b3d
  

  ywang96

  and

  ywang96

  authored
  7379b3d

  Copy full SHA for 7379b3d

• [Model] Add JambaForSequenceClassification model (#10860)

  Show description for 6c7f881
  

  3 peopleauthored
  6c7f881

  Copy full SHA for 6c7f881

• [Bugfix] Cleanup Pixtral HF code (#11333)

  Show description for a0f7d53
  DarkLight1337

  authored
  a0f7d53

  Copy full SHA for a0f7d53

• [Feature] Add load generation config from model (#11164)

  Show description for 5aef498
  

  liuyanyi

  and

  DarkLight1337

  authored
  5aef498

  Copy full SHA for 5aef498

• [misc] benchmark_throughput : Add LoRA (#11267)

  Show description for 9835673
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  9835673

  Copy full SHA for 9835673

• [Misc] Optimize ray worker initialization time (#11275)

  Show description for f26c4ae
  

  ruisearch42

  and

  comaniac

  authored
  f26c4ae

  Copy full SHA for f26c4ae

• [Kernel] Refactor Cutlass c3x (#10049)

  Show description for 8936316
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  8936316

  Copy full SHA for 8936316

• [VLM] Merged multimodal processor for Qwen2-Audio (#11303)

  Show description for 6142ef0
  DarkLight1337

  authored
  6142ef0

  Copy full SHA for 6142ef0

• [V1] Simplify prefix caching logic by removing `num_evictable_computed_blocks` (#11310)

  heheda12345

  authored
  c6b0a7d

  Copy full SHA for c6b0a7d

• [CI] Expand test_guided_generate to test all backends (#11313)

  Show description for a30482f
  mgoin

  authored
  a30482f

  Copy full SHA for a30482f

• [Model] IBM Granite 3.1 (#11307)

  Show description for 17ca964
  tjohnson31415

  authored
  17ca964

  Copy full SHA for 17ca964