Commits

Breadcrumbs

History for

onminimal-gptq

User selector

All users

All time

Commit history

Commits on Oct 30, 2023

• Refactor LLMEngine demo script for clarity and modularity (#1413)

  Show description for ac8d36f
  

  iongpt

  and

  zhuohan123

  authored
  ac8d36fView commit details

  Copy full SHA for ac8d36f

  View code at this pointBrowse repository at this point

Commits on Oct 16, 2023

• Implement prompt logprobs & Batched topk for computing logprobs (#1328)

  Show description for 9d9072a
  

  zhuohan123

  and

  wanmok

  authored
  9d9072aView commit details

  Copy full SHA for 9d9072a

  View code at this pointBrowse repository at this point

Commits on Oct 7, 2023

• API server support ipv4 / ipv6 dualstack (#1288)

  Show description for 09ff7f1
  

  yunfeng-scale

  and

  zhuohan123

  authored
  09ff7f1View commit details

  Copy full SHA for 09ff7f1

  View code at this pointBrowse repository at this point

Commits on Aug 2, 2023

• Refactor scheduler (#658)

  WoosukKwon

  authored
  55fe8a8View commit details

  Copy full SHA for 55fe8a8

  View code at this pointBrowse repository at this point

• Add Falcon support (new) (#592)

  zhuohan123

  authored
  1b0bd0fView commit details

  Copy full SHA for 1b0bd0f

  View code at this pointBrowse repository at this point

Commits on Jul 26, 2023

• [Fix] Add chat completion Example and simplify dependencies (#576)

  zhuohan123

  authored
  82ad323View commit details

  Copy full SHA for 82ad323

  View code at this pointBrowse repository at this point

Commits on Jul 3, 2023

• [Quality] Add code formatter and linter (#326)

  zhuohan123

  authored
  d6fa1beView commit details

  Copy full SHA for d6fa1be

  View code at this pointBrowse repository at this point

Commits on Jun 22, 2023

• [Bugfix] Fix a bug in RequestOutput.finished (#202)

  WoosukKwon

  authored
  14f0b39View commit details

  Copy full SHA for 14f0b39

  View code at this pointBrowse repository at this point

Commits on Jun 17, 2023

• Change the name to vLLM (#150)

  WoosukKwon

  authored
  0b98ba1View commit details

  Copy full SHA for 0b98ba1

  View code at this pointBrowse repository at this point

• Rename servers to engines (#152)

  zhuohan123

  authored
  e5464eeView commit details

  Copy full SHA for e5464ee

  View code at this pointBrowse repository at this point

Commits on Jun 16, 2023

• Rename servers and change port numbers to reduce confusion (#149)

  zhuohan123

  authored
  eedb46bView commit details

  Copy full SHA for eedb46b

  View code at this pointBrowse repository at this point

Commits on Jun 15, 2023

• Add script for benchmarking serving throughput (#145)

  WoosukKwon

  authored
  311490aView commit details

  Copy full SHA for 311490a

  View code at this pointBrowse repository at this point

Commits on Jun 10, 2023

• Non-streaming simple fastapi server (#144)

  zhuohan123

  authored
  5020e1eView commit details

  Copy full SHA for 5020e1e

  View code at this pointBrowse repository at this point

Commits on Jun 7, 2023

• Add docstrings for LLMServer and related classes and examples (#142)

  zhuohan123

  authored
  4298374View commit details

  Copy full SHA for 4298374

  View code at this pointBrowse repository at this point

Commits on May 28, 2023

• Add throughput benchmarking script (#133)

  WoosukKwon

  authored
  211318dView commit details

  Copy full SHA for 211318d

  View code at this pointBrowse repository at this point

Commits on May 24, 2023

• OpenAI Compatible Frontend (#116)

  zhuohan123

  authored
  057daefView commit details

  Copy full SHA for 057daef

  View code at this pointBrowse repository at this point

Commits on May 22, 2023

• Introduce LLM class for offline inference (#115)

  WoosukKwon

  authored
  655a5e4View commit details

  Copy full SHA for 655a5e4

  View code at this pointBrowse repository at this point

Commits on May 21, 2023

• Implement stop strings and best_of (#114)

  WoosukKwon

  authored
  f746cedView commit details

  Copy full SHA for f746ced

  View code at this pointBrowse repository at this point

Commits on May 20, 2023

• Refactor system architecture (#109)

  WoosukKwon

  authored
  c3442c1View commit details

  Copy full SHA for c3442c1

  View code at this pointBrowse repository at this point

Loading