Commits

Breadcrumbs

History for

onminimal-gptq

User selector

All users

All time

Commit history

Commits on Nov 8, 2023

• data -> data_ptr

  WoosukKwon

  committed
  e81599dView commit details

  Copy full SHA for e81599d

  View code at this pointBrowse repository at this point

Commits on Nov 7, 2023

• Prevent name conflict & Use gpuAtomicAddd

  WoosukKwon

  committed
  a2163a5View commit details

  Copy full SHA for a2163a5

  View code at this pointBrowse repository at this point

• Prevent name conflict

  WoosukKwon

  committed
  9e6fdf2View commit details

  Copy full SHA for 9e6fdf2

  View code at this pointBrowse repository at this point

• Merge branch 'main' into minimal-gptq

  WoosukKwon

  committed
  af5e30aView commit details

  Copy full SHA for af5e30a

  View code at this pointBrowse repository at this point

• Minor

  WoosukKwon

  committed
  5f376b7View commit details

  Copy full SHA for 5f376b7

  View code at this pointBrowse repository at this point

• Clean up GPTQ kernel

  WoosukKwon

  committed
  26f48f9View commit details

  Copy full SHA for 26f48f9

  View code at this pointBrowse repository at this point

• Use current stream for SqueezeLLM

  WoosukKwon

  committed
  bda70b8View commit details

  Copy full SHA for bda70b8

  View code at this pointBrowse repository at this point

• Remove GPTQ kernels

  WoosukKwon

  committed
  68017c3View commit details

  Copy full SHA for 68017c3

  View code at this pointBrowse repository at this point

Commits on Nov 3, 2023

• Support YaRN models (#1264)

  Show description for 9f669a9
  

  3 peopleauthored
  9f669a9View commit details

  Copy full SHA for 9f669a9

  View code at this pointBrowse repository at this point

Commits on Nov 2, 2023

• Use exllama v2 kernels for better performance

  chu-tianxiang

  committed
  2593dfeView commit details

  Copy full SHA for 2593dfe

  View code at this pointBrowse repository at this point

Commits on Oct 31, 2023

• Fix integer overflows in attention & cache ops (#1514)

  WoosukKwon

  authored
  0ce8647View commit details

  Copy full SHA for 0ce8647

  View code at this pointBrowse repository at this point

Commits on Oct 24, 2023

• Merge main branch

  chu-tianxiang

  committed
  b51ebb7View commit details

  Copy full SHA for b51ebb7

  View code at this pointBrowse repository at this point

• Fix conflict

  chu-tianxiang

  committed
  a7b391dView commit details

  Copy full SHA for a7b391d

  View code at this pointBrowse repository at this point

Commits on Oct 22, 2023

• Support SqueezeLLM (#1326)

  Show description for 1f24755
  

  3 peopleauthored
  1f24755View commit details

  Copy full SHA for 1f24755

  View code at this pointBrowse repository at this point

Commits on Oct 17, 2023

• Change scheduler & input tensor shape (#1381)

  WoosukKwon

  authored
  c1376e0View commit details

  Copy full SHA for c1376e0

  View code at this pointBrowse repository at this point

Commits on Oct 16, 2023

• Implement PagedAttention V2 (#1348)

  WoosukKwon

  authored
  928de46View commit details

  Copy full SHA for 928de46

  View code at this pointBrowse repository at this point

• Minor fix on AWQ kernel launch (#1356)

  WoosukKwon

  authored
  29678cdView commit details

  Copy full SHA for 29678cd

  View code at this pointBrowse repository at this point

Commits on Oct 11, 2023

• Fix overflow in awq kernel (#1295)

  Show description for 980dd4a
  chu-tianxiang

  authored
  980dd4aView commit details

  Copy full SHA for 980dd4a

  View code at this pointBrowse repository at this point

• workaround of AWQ for Turing GPUs (#1252)

  twaka

  authored
  8285736View commit details

  Copy full SHA for 8285736

  View code at this pointBrowse repository at this point

Commits on Oct 8, 2023

• Merge main branch

  chu-tianxiang

  committed
  92c7f8dView commit details

  Copy full SHA for 92c7f8d

  View code at this pointBrowse repository at this point

Commits on Oct 1, 2023

• Fix boundary check in paged attention kernel (#1241)

  soundOfDestiny

  authored
  ebe4d1dView commit details

  Copy full SHA for ebe4d1d

  View code at this pointBrowse repository at this point

Commits on Sep 27, 2023

• Add fallback kernel for desc act models

  chu-tianxiang

  committed
  5563578View commit details

  Copy full SHA for 5563578

  View code at this pointBrowse repository at this point

• Allocate more shared memory to attention kernel (#1154)

  Yard1

  authored
  cf5cb1eView commit details

  Copy full SHA for cf5cb1e

  View code at this pointBrowse repository at this point

Commits on Sep 25, 2023

• Add more models

  chu-tianxiang

  committed
  612d7b1View commit details

  Copy full SHA for 612d7b1

  View code at this pointBrowse repository at this point

Commits on Sep 18, 2023

• Add minimum capability requirement for AWQ (#1064)

  WoosukKwon

  authored
  2b1c116View commit details

  Copy full SHA for 2b1c116

  View code at this pointBrowse repository at this point

• Add gptq implementation compatible with awq interface

  chu-tianxiang

  committed
  82e6b2eView commit details

  Copy full SHA for 82e6b2e

  View code at this pointBrowse repository at this point

Commits on Sep 16, 2023

• Implement AWQ quantization support for LLaMA (#1032)

  Show description for e3e79e9
  

  5 peopleauthored
  e3e79e9View commit details

  Copy full SHA for e3e79e9

  View code at this pointBrowse repository at this point

Commits on Sep 7, 2023

• [FIX] Fix Alibi implementation in PagedAttention kernel (#945)

  Show description for db09d4a
  

  3 peopleauthored
  db09d4aView commit details

  Copy full SHA for db09d4a

  View code at this pointBrowse repository at this point

Commits on Sep 6, 2023

• [BugFix] Implement RoPE for GPT-J (#941)

  WoosukKwon

  authored
  320a622View commit details

  Copy full SHA for 320a622

  View code at this pointBrowse repository at this point

Commits on Sep 4, 2023

• [BugFix] Fix NaN errors in paged attention kernel (#936)

  WoosukKwon

  authored
  bf87484View commit details

  Copy full SHA for bf87484

  View code at this pointBrowse repository at this point

Commits on Sep 2, 2023

• Avoid compiling kernels for double data type (#933)

  WoosukKwon

  authored
  8ce9c50View commit details

  Copy full SHA for 8ce9c50

  View code at this pointBrowse repository at this point

Commits on Aug 22, 2023

• Implement approximate GELU kernels (#828)

  WoosukKwon

  authored
  d64bf16View commit details

  Copy full SHA for d64bf16

  View code at this pointBrowse repository at this point

Commits on Aug 4, 2023

• [OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (#420)

  naed90

  authored
  79af7e9View commit details

  Copy full SHA for 79af7e9

  View code at this pointBrowse repository at this point

Commits on Aug 2, 2023

• Add Falcon support (new) (#592)

  zhuohan123

  authored
  1b0bd0fView commit details

  Copy full SHA for 1b0bd0f

  View code at this pointBrowse repository at this point

Commits on Jul 20, 2023

• Add support for LLaMA-2 (#505)

  zhuohan123

  authored
  6fc2a38View commit details

  Copy full SHA for 6fc2a38

  View code at this pointBrowse repository at this point