Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Dec 20, 2024

• [doc] explain nccl requirements for rlhf (#11381)

  Show description for 5d2248d
  youkaichao

  authored
  5d2248dView commit details

  Copy full SHA for 5d2248d

  View code at this pointBrowse repository at this point

• [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

  Show description for 995f562
  omer-dayan

  authored
  995f562View commit details

  Copy full SHA for 995f562

  View code at this pointBrowse repository at this point

• [doc] backward compatibility for 0.6.4 (#11359)

  Show description for 1ecc645
  youkaichao

  authored
  1ecc645View commit details

  Copy full SHA for 1ecc645

  View code at this pointBrowse repository at this point

• [ci][gh200] dockerfile clean up (#11351)

  Show description for 7801f56
  

  3 peopleauthored
  7801f56View commit details

  Copy full SHA for 7801f56

  View code at this pointBrowse repository at this point

Commits on Dec 19, 2024

• [Model] Add JambaForSequenceClassification model (#10860)

  Show description for 6c7f881
  

  3 peopleauthored
  6c7f881View commit details

  Copy full SHA for 6c7f881

  View code at this pointBrowse repository at this point

• [Model] IBM Granite 3.1 (#11307)

  Show description for 17ca964
  tjohnson31415

  authored
  17ca964View commit details

  Copy full SHA for 17ca964

  View code at this pointBrowse repository at this point

Commits on Dec 17, 2024

• [Frontend] Add OpenAI API support for input_audio (#11027)

  Show description for 66d4b16
  

  kylehh

  and

  DarkLight1337

  authored
  66d4b16View commit details

  Copy full SHA for 66d4b16

  View code at this pointBrowse repository at this point

• fix gh200 tests on main (#11246)

  Show description for 35bae11
  youkaichao

  authored
  35bae11View commit details

  Copy full SHA for 35bae11

  View code at this pointBrowse repository at this point

Commits on Dec 16, 2024

• [Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235)

  Show description for 35ffa68
  

  bk-TurbaAI

  and

  mgoin

  authored
  35ffa68View commit details

  Copy full SHA for 35ffa68

  View code at this pointBrowse repository at this point

• [Model] Support Cohere2ForCausalLM (Cohere R7B) (#11203)

  janimo

  authored
  bddbbcbView commit details

  Copy full SHA for bddbbcb

  View code at this pointBrowse repository at this point

• WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212)

  Show description for b3b1526
  

  cennn

  and

  drikster80

  authored
  b3b1526View commit details

  Copy full SHA for b3b1526

  View code at this pointBrowse repository at this point

• Update deploying_with_k8s.rst (#10922)

  AlexHe99

  authored
  da6f409View commit details

  Copy full SHA for da6f409

  View code at this pointBrowse repository at this point

Commits on Dec 15, 2024

• [Doc] add documentation for disaggregated prefilling (#11197)

  Show description for 38e599d
  KuntaiDu

  authored
  38e599dView commit details

  Copy full SHA for 38e599d

  View code at this pointBrowse repository at this point

• [[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

  jeejeelee

  authored
  15859f2View commit details

  Copy full SHA for 15859f2

  View code at this pointBrowse repository at this point

Commits on Dec 14, 2024

• [Core] V1: Use multiprocessing by default (#11074)

  Show description for 4863e5f
  russellb

  authored
  4863e5fView commit details

  Copy full SHA for 4863e5f

  View code at this pointBrowse repository at this point

Commits on Dec 13, 2024

• [Doc] Reorganize online pooling APIs (#11172)

  Show description for 0920ab9
  DarkLight1337

  authored
  0920ab9View commit details

  Copy full SHA for 0920ab9

  View code at this pointBrowse repository at this point

• [Frontend] Separate pooling APIs in offline inference (#11129)

  Show description for eeec9e3
  DarkLight1337

  authored
  eeec9e3View commit details

  Copy full SHA for eeec9e3

  View code at this pointBrowse repository at this point

• PaliGemma 2 support (#11142)

  janimo

  authored
  7cd7409View commit details

  Copy full SHA for 7cd7409

  View code at this pointBrowse repository at this point

Commits on Dec 12, 2024

• fix(docs): typo in helm install instructions (#11141)

  Show description for d4d5291
  ramonziai

  authored
  d4d5291View commit details

  Copy full SHA for d4d5291

  View code at this pointBrowse repository at this point

• [Model] Add support for embedding model GritLM (#10816)

  Show description for 1da8f0e
  pooyadavoodi

  authored
  1da8f0eView commit details

  Copy full SHA for 1da8f0e

  View code at this pointBrowse repository at this point

• Update link to LlamaStack remote vLLM guide in serving_with_llamastack.rst (#11112)

  Show description for 24a36d6
  terrytangyuan

  authored
  24a36d6View commit details

  Copy full SHA for 24a36d6

  View code at this pointBrowse repository at this point

Commits on Dec 11, 2024

• [Doc] Installed version of llmcompressor for int8/fp8 quantization (#11103)

  Show description for fd22220
  bingps

  authored
  fd22220View commit details

  Copy full SHA for fd22220

  View code at this pointBrowse repository at this point

• [Doc] Update docs to refer to pooling models (#11093)

  Show description for cad5c0a
  DarkLight1337

  authored
  cad5c0aView commit details

  Copy full SHA for cad5c0a

  View code at this pointBrowse repository at this point

• [Misc] Split up pooling tasks (#10820)

  Show description for 8f10d5e
  DarkLight1337

  authored
  8f10d5eView commit details

  Copy full SHA for 8f10d5e

  View code at this pointBrowse repository at this point

• [Model] PP support for Mamba-like models (#10992)

  Show description for ffa48c9
  mzusman

  authored
  ffa48c9View commit details

  Copy full SHA for ffa48c9

  View code at this pointBrowse repository at this point

Commits on Dec 10, 2024

• Add example of helm chart for vllm deployment on k8s (#9199)

  Show description for fe2e10c
  mfournioux

  authored
  fe2e10cView commit details

  Copy full SHA for fe2e10c

  View code at this pointBrowse repository at this point

• [Frontend] Use request id from header (#10968)

  Show description for 980ad39
  joerunde

  authored
  980ad39View commit details

  Copy full SHA for 980ad39

  View code at this pointBrowse repository at this point

• [Docs] Add dedicated tool calling page to docs (#10554)

  Show description for 6d52528
  

  mgoin

  and

  tlrmchlsmth

  authored
  6d52528View commit details

  Copy full SHA for 6d52528

  View code at this pointBrowse repository at this point

Commits on Dec 9, 2024

• [Doc][V1] Add V1 support column for multimodal models (#10998)

  Show description for af7c4a9
  ywang96

  authored
  af7c4a9View commit details

  Copy full SHA for af7c4a9

  View code at this pointBrowse repository at this point

Commits on Dec 7, 2024

• [Doc] Explicitly state that PP isn't compatible with speculative decoding yet (#10975)

  Show description for c889d58
  DarkLight1337

  authored
  c889d58View commit details

  Copy full SHA for c889d58

  View code at this pointBrowse repository at this point

• [Model] Update multi-modal processor to support Mantis(LLaVA) model (#10711)

  Show description for 39e227c
  DarkLight1337

  authored
  39e227cView commit details

  Copy full SHA for 39e227c

  View code at this pointBrowse repository at this point

• [Doc] Explicitly state that InternVL 2.5 is supported (#10978)

  Show description for 1c768fe
  DarkLight1337

  authored
  1c768feView commit details

  Copy full SHA for 1c768fe

  View code at this pointBrowse repository at this point

Commits on Dec 6, 2024

• [Doc] add KubeAI to serving integrations (#10837)

  Show description for 7406274
  samos123

  authored
  7406274View commit details

  Copy full SHA for 7406274

  View code at this pointBrowse repository at this point

Commits on Dec 5, 2024

• [Doc] Create a new "Usage" section (#10827)

  Show description for aa39a8e
  DarkLight1337

  authored
  aa39a8eView commit details

  Copy full SHA for aa39a8e

  View code at this pointBrowse repository at this point

Commits on Dec 4, 2024

• [CI/Build] improve python-only dev setup (#9621)

  Show description for e4c34c2
  

  dtrifiro

  and

  youkaichao

  authored
  e4c34c2View commit details

  Copy full SHA for e4c34c2

  View code at this pointBrowse repository at this point