Commits

Breadcrumbs

History for

onminimal-gptq

User selector

All users

All time

Commit history

Commits on Nov 7, 2023

• Minor

  WoosukKwon

  committed
  fe25f75View commit details

  Copy full SHA for fe25f75

  View code at this pointBrowse repository at this point

Commits on Oct 24, 2023

• Fix squeezellm

  chu-tianxiang

  committed
  9a99461View commit details

  Copy full SHA for 9a99461

  View code at this pointBrowse repository at this point

Commits on Oct 22, 2023

• Support SqueezeLLM (#1326)

  Show description for 1f24755
  

  3 peopleauthored
  1f24755View commit details

  Copy full SHA for 1f24755

  View code at this pointBrowse repository at this point

Commits on Oct 16, 2023

• Implement PagedAttention V2 (#1348)

  WoosukKwon

  authored
  928de46View commit details

  Copy full SHA for 928de46

  View code at this pointBrowse repository at this point

Commits on Oct 3, 2023

• Use monotonic time where appropriate (#1249)

  Yard1

  authored
  acbed3eView commit details

  Copy full SHA for acbed3e

  View code at this pointBrowse repository at this point

Commits on Oct 1, 2023

• Added `dtype` arg to benchmarks (#1228)

  kg6-sleipnir

  authored
  b5a10ebView commit details

  Copy full SHA for b5a10eb

  View code at this pointBrowse repository at this point

Commits on Sep 16, 2023

• Implement AWQ quantization support for LLaMA (#1032)

  Show description for e3e79e9
  

  5 peopleauthored
  e3e79e9View commit details

  Copy full SHA for e3e79e9

  View code at this pointBrowse repository at this point

Commits on Jul 20, 2023

• fix: enable trust-remote-code in api server & benchmark. (#509)

  gesanqiu

  authored
  8c4b259View commit details

  Copy full SHA for 8c4b259

  View code at this pointBrowse repository at this point

• support trust_remote_code in benchmark (#518)

  wangruohui

  authored
  cf21a9bView commit details

  Copy full SHA for cf21a9b

  View code at this pointBrowse repository at this point

Commits on Jun 28, 2023

• [Tokenizer] Add an option to specify tokenizer (#284)

  WoosukKwon

  authored
  4338cc4View commit details

  Copy full SHA for 4338cc4

  View code at this pointBrowse repository at this point

Commits on Jun 26, 2023

• [Fix] Fix default port number in benchmark scripts (#265)

  zhuohan123

  authored
  43710e8View commit details

  Copy full SHA for 43710e8

  View code at this pointBrowse repository at this point

Commits on Jun 19, 2023

• Remove benchmark_async_llm_server.py (#155)

  zhuohan123

  authored
  0370afaView commit details

  Copy full SHA for 0370afa

  View code at this pointBrowse repository at this point

Commits on Jun 18, 2023

• Add comments on swap space (#154)

  WoosukKwon

  authored
  3f92038View commit details

  Copy full SHA for 3f92038

  View code at this pointBrowse repository at this point

Commits on Jun 17, 2023

• Change the name to vLLM (#150)

  WoosukKwon

  authored
  0b98ba1View commit details

  Copy full SHA for 0b98ba1

  View code at this pointBrowse repository at this point

• Rename servers to engines (#152)

  zhuohan123

  authored
  e5464eeView commit details

  Copy full SHA for e5464ee

  View code at this pointBrowse repository at this point

• [Minor] Fix benchmark_throughput.py (#151)

  WoosukKwon

  authored
  bab8f3dView commit details

  Copy full SHA for bab8f3d

  View code at this pointBrowse repository at this point

Commits on Jun 16, 2023

• Rename servers and change port numbers to reduce confusion (#149)

  zhuohan123

  authored
  eedb46bView commit details

  Copy full SHA for eedb46b

  View code at this pointBrowse repository at this point

Commits on Jun 15, 2023

• Add script for benchmarking serving throughput (#145)

  WoosukKwon

  authored
  311490aView commit details

  Copy full SHA for 311490a

  View code at this pointBrowse repository at this point

Commits on Jun 5, 2023

• Fix various issues of async servers (#135)

  zhuohan123

  authored
  1a956e1View commit details

  Copy full SHA for 1a956e1

  View code at this pointBrowse repository at this point

Commits on Jun 4, 2023

• Add docstrings for LLM (#137)

  WoosukKwon

  authored
  8274ca2View commit details

  Copy full SHA for 8274ca2

  View code at this pointBrowse repository at this point

Commits on May 28, 2023

• Add throughput benchmarking script (#133)

  WoosukKwon

  authored
  211318dView commit details

  Copy full SHA for 211318d

  View code at this pointBrowse repository at this point

Loading