Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 9, 2025

• [Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434)

  Show description for 6bbf179
  B-201

  authored
  6bbf179

  Copy full SHA for 6bbf179

• Fix bullets in incremental_build.md (#20642)

  mgoin

  authored
  9e0ef88

  Copy full SHA for 9e0ef88

• [feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640)

  Show description for 97abeb1
  djmmoss

  authored
  97abeb1

  Copy full SHA for 97abeb1

• [Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628)

  Show description for 34dad19
  izhuhaoran

  authored
  34dad19

  Copy full SHA for 34dad19

• [Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554)

  Show description for 6db31e7
  

  3 peopleauthored
  6db31e7

  Copy full SHA for 6db31e7

• [Docs] Improve documentation for multi-node service helper script (#20600)

  Show description for 977180c
  crypdick

  authored
  977180c

  Copy full SHA for 977180c

• [BugFix][Intel GPU] Use refactored API for dist_backend in V1 worker (#20596)

  Show description for c40784c
  ratnampa

  authored
  c40784c

  Copy full SHA for c40784c

• [tech debt] Revisit lora request model checker (#20636)

  Show description for baed180
  kouroshHakha

  authored
  baed180

  Copy full SHA for baed180

• [misc]refactor `Platform.set_device` method (#20262)

  Show description for 0b40747
  jikunshang

  authored
  0b40747

  Copy full SHA for 0b40747

• Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang Template Parameter Issue (#20142)

  Show description for 5eaf570
  wenxin0319

  authored
  5eaf570

  Copy full SHA for 5eaf570

Commits on Jul 8, 2025

• [TPU][Bugfix] disable phi-3 test (#20632)

  Show description for d8ee5a2
  QiliangCui

  authored
  d8ee5a2

  Copy full SHA for d8ee5a2

• [Bugfix] Fix GLM-4.1-V video prompt update (#20635)

  Show description for b9fca83
  Isotr0py

  authored
  b9fca83

  Copy full SHA for b9fca83

• [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630)

  Show description for 32dffc2
  DarkLight1337

  authored
  32dffc2

  Copy full SHA for 32dffc2

• [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166)

  Show description for c438183
  minosfuture

  authored
  c438183

  Copy full SHA for c438183

• [CI] Increase the threshold of the MTEB RERANK tests (#20615)

  Show description for baba038
  noooop

  authored
  baba038

  Copy full SHA for baba038

• Revert invalid spellchecker fix on deepseek_vl2 (#20618)

  viravera

  authored
  c6c22f1

  Copy full SHA for c6c22f1

• [Model] Implement missing `get_language_model` for Keye-VL (#20631)

  Show description for dd382e0
  DarkLight1337

  authored
  dd382e0

  Copy full SHA for dd382e0

• Update torch/xla pin to 20250703 (#20589)

  Show description for 849590a
  vanbasten23

  authored
  849590a

  Copy full SHA for 849590a

• [xpu]feat: support multi-lora on xpu (#20616)

  Show description for a4c2331
  yma11

  authored
  a4c2331

  Copy full SHA for a4c2331

• Stop using title frontmatter and fix doc that can only be reached by search (#20623)

  Show description for b942c09
  hmellor

  authored
  b942c09

  Copy full SHA for b942c09

• Remove unnecessary explicit title anchors and use relative links instead (#20620)

  Show description for b4bab81
  hmellor

  authored
  b4bab81

  Copy full SHA for b4bab81

• [Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601)

  Show description for b91cb3f
  crypdick

  authored
  b91cb3f

  Copy full SHA for b91cb3f

• [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139)

  Show description for 71d1d75
  NickLucche

  authored
  71d1d75

  Copy full SHA for 71d1d75

• [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)

  Show description for 72d14d0
  

  sangstar

  and

  Eta0

  authored
  72d14d0

  Copy full SHA for 72d14d0

• [TPU] Temporary fix vmem oom for long model len by reducing page size (#20278)

  Show description for e34d130
  Chenyaaang

  authored
  e34d130

  Copy full SHA for e34d130

• [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560)

  Show description for 7721ef1
  bigPYJ1151

  authored
  7721ef1

  Copy full SHA for 7721ef1

• [Misc] improve error msg (#20604)

  Show description for 8369b7c
  reidliu41

  authored
  8369b7c

  Copy full SHA for 8369b7c

• [Docs] Add Anyscale to frameworks (#20590)

  Show description for 3eb4ad5
  crypdick

  authored
  3eb4ad5

  Copy full SHA for 3eb4ad5

• [Docs] Add Ray Serve LLM section to openai compatible server guide (#20595)

  Show description for 90a2769
  crypdick

  authored
  90a2769

  Copy full SHA for 90a2769

• [Docs] Improve docstring for ray data llm example (#20597)

  Show description for e60d422
  crypdick

  authored
  e60d422

  Copy full SHA for e60d422

• [Docs] Rewrite offline inference guide (#20594)

  Show description for 0d914c8
  crypdick

  authored
  0d914c8

  Copy full SHA for 0d914c8

• [Doc] Syntax highlight request responses as JSON instead of bash (#20582)

  Show description for 6e428cd
  hmellor

  authored
  6e428cd

  Copy full SHA for 6e428cd

• [Bugfix]: Fix messy code when using logprobs (#19209)

  Show description for 93b9d9f
  chaunceyjiang

  authored
  93b9d9f

  Copy full SHA for 93b9d9f

• Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585)

  Show description for af107d5
  hmellor

  authored
  af107d5

  Copy full SHA for af107d5

• [Optimize] Don't send token ids when kv connector is not used (#20586)

  Show description for 31c5d0a
  WoosukKwon

  authored
  31c5d0a

  Copy full SHA for 31c5d0a

Pagination

Previous

Next