Commits

Breadcrumbs

History for

onqmm

User selector

All users

All time

Commit history

Commits on Dec 17, 2023

• [Docs] Update documentation for gpu-memory-utilization option (#2162)

  SuhongMoon

  authored
  3ec8c25View commit details

  Copy full SHA for 3ec8c25

  View code at this pointBrowse repository at this point

• [Minor] Add Phi 2 to supported models (#2159)

  WoosukKwon

  authored
  f8c688dView commit details

  Copy full SHA for f8c688d

  View code at this pointBrowse repository at this point

• [Docs] Add CUDA graph support to docs (#2148)

  WoosukKwon

  authored
  26c52a5View commit details

  Copy full SHA for 26c52a5

  View code at this pointBrowse repository at this point

Commits on Dec 15, 2023

• [Docs] Add supported quantization methods to docs (#2135)

  WoosukKwon

  authored
  b81a6a6View commit details

  Copy full SHA for b81a6a6

  View code at this pointBrowse repository at this point

Commits on Dec 14, 2023

• Optimize Mixtral with expert parallelism (#2090)

  Yard1

  authored
  21d93c1View commit details

  Copy full SHA for 21d93c1

  View code at this pointBrowse repository at this point

Commits on Dec 13, 2023

• [Docs] Add notes on ROCm-supported models (#2087)

  WoosukKwon

  authored
  096827cView commit details

  Copy full SHA for 096827c

  View code at this pointBrowse repository at this point

• Update installation instruction for vLLM + CUDA 11.8 (#2086)

  WoosukKwon

  authored
  6565d9eView commit details

  Copy full SHA for 6565d9e

  View code at this pointBrowse repository at this point

• [ROCm] Upgrade xformers version for ROCm & update doc (#2079)

  Show description for f375ec8
  

  tjtanaa

  and

  big-yellow-duck

  authored
  f375ec8View commit details

  Copy full SHA for f375ec8

  View code at this pointBrowse repository at this point

Commits on Dec 11, 2023

• Update run_on_sky.rst (#2025)

  Show description for c0ce15d
  eltociear

  authored
  c0ce15dView commit details

  Copy full SHA for c0ce15d

  View code at this pointBrowse repository at this point

• Minor fixes for Mixtral (#2015)

  WoosukKwon

  authored
  4ff0203View commit details

  Copy full SHA for 4ff0203

  View code at this pointBrowse repository at this point

Commits on Dec 8, 2023

• [Docker] Add cuda arch list as build option (#1950)

  simon-mo

  authored
  c85b80cView commit details

  Copy full SHA for c85b80c

  View code at this pointBrowse repository at this point

• Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)

  Show description for 6ccc0bf
  

  4 peopleauthored
  6ccc0bfView commit details

  Copy full SHA for 6ccc0bf

  View code at this pointBrowse repository at this point

Commits on Dec 7, 2023

• [Docker] Adding number of nvcc_threads during build as envar (#1893)

  AguirreNicolas

  authored
  24f60a5View commit details

  Copy full SHA for 24f60a5

  View code at this pointBrowse repository at this point

• Fix quickstart.rst typo jinja (#1964)

  gottlike

  authored
  42c02f5View commit details

  Copy full SHA for 42c02f5

  View code at this pointBrowse repository at this point

Commits on Dec 6, 2023

• Fix typo in adding_model.rst (#1947)

  Show description for d940ce4
  petergtz

  authored
  d940ce4View commit details

  Copy full SHA for d940ce4

  View code at this pointBrowse repository at this point

Commits on Dec 3, 2023

• chore(examples-docs): upgrade to OpenAI V1 (#1785)

  mspronesti

  authored
  c07a442View commit details

  Copy full SHA for c07a442

  View code at this pointBrowse repository at this point

• Add Production Metrics in Prometheus format (#1890)

  simon-mo

  authored
  5313c2cView commit details

  Copy full SHA for 5313c2c

  View code at this pointBrowse repository at this point

Commits on Dec 2, 2023

• [Docs] Update the AWQ documentation to highlight performance issue (#1883)

  simon-mo

  authored
  4cefa9bView commit details

  Copy full SHA for 4cefa9b

  View code at this pointBrowse repository at this point

Commits on Dec 1, 2023

• Normalize head weights for Baichuan 2 (#1876)

  WoosukKwon

  authored
  e5452ddView commit details

  Copy full SHA for e5452dd

  View code at this pointBrowse repository at this point

• Support chat template and `echo` for chat API (#1756)

  Tostino

  authored
  66785ccView commit details

  Copy full SHA for 66785cc

  View code at this pointBrowse repository at this point

Commits on Nov 30, 2023

• docs: add instruction for langchain (#1162)

  mspronesti

  authored
  05a3861View commit details

  Copy full SHA for 05a3861

  View code at this pointBrowse repository at this point

• [Docs] Add information about using shared memory in docker (#1845)

  simon-mo

  authored
  0f621c2View commit details

  Copy full SHA for 0f621c2

  View code at this pointBrowse repository at this point

Commits on Nov 22, 2023

• [DOCS] Add engine args documentation (#1741)

  casper-hansen

  authored
  a921d8bView commit details

  Copy full SHA for a921d8b

  View code at this pointBrowse repository at this point

Commits on Nov 20, 2023

• [Docs] Fix the code block's format in deploying_with_docker page (#1722)

  HermitSun

  authored
  112627eView commit details

  Copy full SHA for 112627e

  View code at this pointBrowse repository at this point

• Documentation about official docker image (#1709)

  simon-mo

  authored
  37c1e3cView commit details

  Copy full SHA for 37c1e3c

  View code at this pointBrowse repository at this point

Commits on Nov 19, 2023

• Add instructions to install vLLM+cu118 (#1717)

  WoosukKwon

  authored
  06e9ebeView commit details

  Copy full SHA for 06e9ebe

  View code at this pointBrowse repository at this point

Commits on Nov 18, 2023

• Support download models from www.modelscope.cn (#1588)

  liuyhwangyh

  authored
  edb3055View commit details

  Copy full SHA for edb3055

  View code at this pointBrowse repository at this point

Commits on Nov 17, 2023

• Update the adding-model doc according to the new refactor (#1692)

  zhuohan123

  authored
  0fc280bView commit details

  Copy full SHA for 0fc280b

  View code at this pointBrowse repository at this point

Commits on Nov 16, 2023

• [Fix] Update Supported Models List (#1690)

  zhuohan123

  authored
  415d109View commit details

  Copy full SHA for 415d109

  View code at this pointBrowse repository at this point

Commits on Nov 5, 2023

• Add Quantization and AutoAWQ to docs (#1235)

  casper-hansen

  authored
  8516999View commit details

  Copy full SHA for 8516999

  View code at this pointBrowse repository at this point

Commits on Oct 31, 2023

• Add Dockerfile (#1350)

  skrider

  authored
  9cabcb7View commit details

  Copy full SHA for 9cabcb7

  View code at this pointBrowse repository at this point

Commits on Oct 9, 2023

• Update README.md (#1292)

  zhuohan123

  authored
  9eed4d1View commit details

  Copy full SHA for 9eed4d1

  View code at this pointBrowse repository at this point

Commits on Sep 29, 2023

• fixing typo in `tiiuae/falcon-rw-7b` model name (#1226)

  0ssamaak0

  authored
  0967102View commit details

  Copy full SHA for 0967102

  View code at this pointBrowse repository at this point

Commits on Sep 28, 2023

• Add Mistral to supported model list (#1221)

  WoosukKwon

  authored
  202351dView commit details

  Copy full SHA for 202351d

  View code at this pointBrowse repository at this point

Commits on Sep 22, 2023

• Docs: Fix broken link to openai example (#1145)

  Show description for 4ee52bb
  nkpz

  authored
  4ee52bbView commit details

  Copy full SHA for 4ee52bb

  View code at this pointBrowse repository at this point