Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 9, 2023

• Update README.md (#1292)

  zhuohan123

  authored
  9eed4d1

  Copy full SHA for 9eed4d1

Commits on Oct 8, 2023

• [FIX] Explain why the finished_reason of ignored sequences are length (#1289)

  zhuohan123

  authored
  6b5296a

  Copy full SHA for 6b5296a

• Move bfloat16 check to worker (#1259)

  Yard1

  authored
  ee92b58

  Copy full SHA for ee92b58

Commits on Oct 7, 2023

• API server support ipv4 / ipv6 dualstack (#1288)

  Show description for 09ff7f1
  

  yunfeng-scale

  and

  zhuohan123

  authored
  09ff7f1

  Copy full SHA for 09ff7f1

Commits on Oct 3, 2023

• Use monotonic time where appropriate (#1249)

  Yard1

  authored
  acbed3e

  Copy full SHA for acbed3e

• add support for tokenizer revision (#1163)

  Show description for 66d18a7
  

  cassanof

  and

  zhuohan123

  authored
  66d18a7

  Copy full SHA for 66d18a7

Commits on Oct 2, 2023

• TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)

  zhuohan123

  authored
  ba0bfd4

  Copy full SHA for ba0bfd4

• [Minor] Fix type annotations (#1238)

  WoosukKwon

  authored
  84e4e37

  Copy full SHA for 84e4e37

• support sharding llama2-70b on more than 8 GPUs (#1209)

  Show description for a60b353
  

  zhuohan123

  and

  wejoncy

  authored
  a60b353

  Copy full SHA for a60b353

Commits on Oct 1, 2023

• Fix boundary check in paged attention kernel (#1241)

  soundOfDestiny

  authored
  ebe4d1d

  Copy full SHA for ebe4d1d

• Added `dtype` arg to benchmarks (#1228)

  kg6-sleipnir

  authored
  b5a10eb

  Copy full SHA for b5a10eb

Commits on Sep 29, 2023

• fixing typo in `tiiuae/falcon-rw-7b` model name (#1226)

  0ssamaak0

  authored
  0967102

  Copy full SHA for 0967102

Commits on Sep 28, 2023

• Bump up the version to v0.2.0 (#1212)

  WoosukKwon

  authored
  e2fb71e

  Copy full SHA for e2fb71e

• Provide default max model length (#1224)

  WoosukKwon

  authored
  f936657

  Copy full SHA for f936657

• Fix OOM in attention kernel test (#1223)

  WoosukKwon

  authored
  6f88f76

  Copy full SHA for 6f88f76

• Add Mistral to supported model list (#1221)

  WoosukKwon

  authored
  202351d

  Copy full SHA for 202351d

• [Fix] Remove false assertion (#1222)

  WoosukKwon

  authored
  2e8e49f

  Copy full SHA for 2e8e49f

• Fix Mistral model (#1220)

  WoosukKwon

  authored
  a8e98ae

  Copy full SHA for a8e98ae

• [Mistral] Mistral-7B-v0.1 support (#1196)

  Show description for bb1ba58
  

  Bam4d

  and

  timlacroix

  authored
  bb1ba58

  Copy full SHA for bb1ba58

• Add rope_scaling to Qwen (#1210)

  Sanster

  authored
  7bedab5

  Copy full SHA for 7bedab5

• Add `skip_special_tokens` sampling params (#1186)

  blahblahasdf

  authored
  20f7cc4

  Copy full SHA for 20f7cc4

• Use standard extras for uvicorn (#1166)

  danilopeixoto

  authored
  649aa73

  Copy full SHA for 649aa73

Commits on Sep 27, 2023

• Automatically configure `max_num_batched_tokens` (#1198)

  WoosukKwon

  authored
  a19bc5c

  Copy full SHA for a19bc5c

• fix qwen-14b model (#1173)

  Sanster

  authored
  28e616c

  Copy full SHA for 28e616c

• fix typo (#1184)

  Show description for 30e7752
  

  WrRan

  and

  zhuohan123

  authored
  30e7752

  Copy full SHA for 30e7752

• Support Longchat and RoPE scaling (#555)

  Show description for 21877b0
  

  3 peopleauthored
  21877b0

  Copy full SHA for 21877b0

• Allocate more shared memory to attention kernel (#1154)

  Yard1

  authored
  cf5cb1e

  Copy full SHA for cf5cb1e

Commits on Sep 26, 2023

• Add comments on RoPE initialization (#1176)

  WoosukKwon

  authored
  03ffd0a

  Copy full SHA for 03ffd0a

• [Setup] Enable `TORCH_CUDA_ARCH_LIST` for selecting target GPUs (#1074)

  WoosukKwon

  authored
  a425bd9

  Copy full SHA for a425bd9

Commits on Sep 24, 2023

• Align `max_tokens` behavior with openai (#852)

  HermitSun

  authored
  bbbf865

  Copy full SHA for bbbf865

• Fix config for Falcon (#1164)

  WoosukKwon

  authored
  9f6be86

  Copy full SHA for 9f6be86

• [FIX] Simplify sampler logic (#1156)

  zhuohan123

  authored
  f187877

  Copy full SHA for f187877

Commits on Sep 23, 2023

• [Sampler] Vectorized sampling (simplified) (#1048)

  Show description for 947b794
  

  zhuohan123

  and

  Yard1

  authored
  947b794

  Copy full SHA for 947b794

Commits on Sep 22, 2023

• Announce the First vLLM Meetup (#1148)

  WoosukKwon

  authored
  8d926e9

  Copy full SHA for 8d926e9

• Docs: Fix broken link to openai example (#1145)

  Show description for 4ee52bb
  nkpz

  authored
  4ee52bb

  Copy full SHA for 4ee52bb

Pagination

Previous

Next