Commits

Breadcrumbs

History for

onminimal-gptq

User selector

All users

All time

Commit history

Commits on Nov 7, 2023

• Merge branch 'main' into minimal-gptq

  WoosukKwon

  committed
  af5e30aView commit details

  Copy full SHA for af5e30a

  View code at this pointBrowse repository at this point

• Fix typo

  WoosukKwon

  committed
  a1d918eView commit details

  Copy full SHA for a1d918e

  View code at this pointBrowse repository at this point

• Fix setup

  WoosukKwon

  committed
  7d2357cView commit details

  Copy full SHA for 7d2357c

  View code at this pointBrowse repository at this point

Commits on Nov 2, 2023

• Use exllama v2 kernels for better performance

  chu-tianxiang

  committed
  2593dfeView commit details

  Copy full SHA for 2593dfe

  View code at this pointBrowse repository at this point

Commits on Oct 31, 2023

• Add Dockerfile (#1350)

  skrider

  authored
  9cabcb7View commit details

  Copy full SHA for 9cabcb7

  View code at this pointBrowse repository at this point

Commits on Oct 30, 2023

• Add py.typed so consumers of vLLM can get type checking (#1509)

  Show description for 79a3091
  

  3 peopleauthored
  79a3091View commit details

  Copy full SHA for 79a3091

  View code at this pointBrowse repository at this point

Commits on Oct 24, 2023

• Merge main branch

  chu-tianxiang

  committed
  b51ebb7View commit details

  Copy full SHA for b51ebb7

  View code at this pointBrowse repository at this point

• Fix conflict

  chu-tianxiang

  committed
  a7b391dView commit details

  Copy full SHA for a7b391d

  View code at this pointBrowse repository at this point

Commits on Oct 22, 2023

• Support SqueezeLLM (#1326)

  Show description for 1f24755
  

  3 peopleauthored
  1f24755View commit details

  Copy full SHA for 1f24755

  View code at this pointBrowse repository at this point

Commits on Oct 14, 2023

• Fix error message on `TORCH_CUDA_ARCH_LIST` (#1239)

  Show description for d0740df
  

  WoosukKwon

  and

  yunfeng-scale

  authored
  d0740dfView commit details

  Copy full SHA for d0740df

  View code at this pointBrowse repository at this point

Commits on Oct 8, 2023

• Merge main branch

  chu-tianxiang

  committed
  92c7f8dView commit details

  Copy full SHA for 92c7f8d

  View code at this pointBrowse repository at this point

Commits on Sep 27, 2023

• Add fallback kernel for desc act models

  chu-tianxiang

  committed
  5563578View commit details

  Copy full SHA for 5563578

  View code at this pointBrowse repository at this point

• Allocate more shared memory to attention kernel (#1154)

  Yard1

  authored
  cf5cb1eView commit details

  Copy full SHA for cf5cb1e

  View code at this pointBrowse repository at this point

Commits on Sep 26, 2023

• [Setup] Enable `TORCH_CUDA_ARCH_LIST` for selecting target GPUs (#1074)

  WoosukKwon

  authored
  a425bd9View commit details

  Copy full SHA for a425bd9

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2023

• Add gptq implementation compatible with awq interface

  chu-tianxiang

  committed
  82e6b2eView commit details

  Copy full SHA for 82e6b2e

  View code at this pointBrowse repository at this point

Commits on Sep 16, 2023

• Implement AWQ quantization support for LLaMA (#1032)

  Show description for e3e79e9
  

  5 peopleauthored
  e3e79e9View commit details

  Copy full SHA for e3e79e9

  View code at this pointBrowse repository at this point

Commits on Sep 11, 2023

• Update setup.py (#1006)

  WoosukKwon

  authored
  d6770d1View commit details

  Copy full SHA for d6770d1

  View code at this pointBrowse repository at this point

Commits on Aug 22, 2023

• Add compute capability 8.9 to default targets (#829)

  WoosukKwon

  authored
  a41c204View commit details

  Copy full SHA for a41c204

  View code at this pointBrowse repository at this point

Commits on Aug 21, 2023

• set default coompute capability according to cuda version (#773)

  zxdvd

  authored
  65fc1c3View commit details

  Copy full SHA for 65fc1c3

  View code at this pointBrowse repository at this point

Commits on Jun 27, 2023

• Update setup.py (#282)

  Show description for 2b7d3ac
  

  comaniac

  and

  neubig

  authored
  2b7d3acView commit details

  Copy full SHA for 2b7d3ac

  View code at this pointBrowse repository at this point

Commits on Jun 20, 2023

• [PyPI] Fix package info in setup.py (#158)

  WoosukKwon

  authored
  570fb2eView commit details

  Copy full SHA for 570fb2e

  View code at this pointBrowse repository at this point

Commits on Jun 18, 2023

• Write README and front page of doc (#147)

  WoosukKwon

  authored
  dcda03bView commit details

  Copy full SHA for dcda03b

  View code at this pointBrowse repository at this point

Commits on Jun 17, 2023

• Change the name to vLLM (#150)

  WoosukKwon

  authored
  0b98ba1View commit details

  Copy full SHA for 0b98ba1

  View code at this pointBrowse repository at this point

Commits on Jun 7, 2023

• Support FP32 (#141)

  WoosukKwon

  authored
  e38074bView commit details

  Copy full SHA for e38074b

  View code at this pointBrowse repository at this point

Commits on Jun 6, 2023

• [PyPI] Packaging for PyPI distribution (#140)

  WoosukKwon

  authored
  376725cView commit details

  Copy full SHA for 376725c

  View code at this pointBrowse repository at this point

Commits on May 27, 2023

• Improve setup script & Add a guard for bfloat16 kernels (#130)

  WoosukKwon

  authored
  d721168View commit details

  Copy full SHA for d721168

  View code at this pointBrowse repository at this point

Commits on May 7, 2023

• Specify python package dependencies in requirements.txt (#78)

  WoosukKwon

  authored
  7addca5View commit details

  Copy full SHA for 7addca5

  View code at this pointBrowse repository at this point

Commits on May 3, 2023

• Support bfloat16 data type (#54)

  WoosukKwon

  authored
  e070829View commit details

  Copy full SHA for e070829

  View code at this pointBrowse repository at this point

• Refactor attention kernels (#53)

  WoosukKwon

  authored
  436e523View commit details

  Copy full SHA for 436e523

  View code at this pointBrowse repository at this point

Commits on Apr 2, 2023

• Optimize data movement (#20)

  WoosukKwon

  authored
  897cb2aView commit details

  Copy full SHA for 897cb2a

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2023

• Add custom kernel for RMS normalization (#16)

  WoosukKwon

  authored
  09e9245View commit details

  Copy full SHA for 09e9245

  View code at this pointBrowse repository at this point

Commits on Mar 30, 2023

• Implement custom kernel for LLaMA rotary embedding (#14)

  WoosukKwon

  authored
  88c0268View commit details

  Copy full SHA for 88c0268

  View code at this pointBrowse repository at this point

Commits on Mar 1, 2023

• Implement `single_query_cached_kv_attention` kernel (#3)

  WoosukKwon

  authored
  0deacbcView commit details

  Copy full SHA for 0deacbc

  View code at this pointBrowse repository at this point

Commits on Feb 16, 2023

• cache_kernel -> cache_kernels

  WoosukKwon

  committed
  ffad4e1View commit details

  Copy full SHA for ffad4e1

  View code at this pointBrowse repository at this point

• Implement cache ops

  WoosukKwon

  committed
  6f058c7View commit details

  Copy full SHA for 6f058c7

  View code at this pointBrowse repository at this point