Commits

Breadcrumbs

History for

onminimal-gptq

User selector

All users

All time

Commit history

Commits on Nov 8, 2023

• Fix input_metadata.selected_token_indices in worker prepare_inputs (#1546)

  ymwangg

  authored
  8efe23fView commit details

  Copy full SHA for 8efe23f

  View code at this pointBrowse repository at this point

Commits on Nov 3, 2023

• Added logits processor API to sampling params (#1469)

  noamgat

  authored
  555bdccView commit details

  Copy full SHA for 555bdcc

  View code at this pointBrowse repository at this point

Commits on Oct 31, 2023

• [Small] Formatter only checks lints in changed files (#1528)

  cadedaniel

  authored
  e575df3View commit details

  Copy full SHA for e575df3

  View code at this pointBrowse repository at this point

• Fix integer overflows in attention & cache ops (#1514)

  WoosukKwon

  authored
  0ce8647View commit details

  Copy full SHA for 0ce8647

  View code at this pointBrowse repository at this point

Commits on Oct 17, 2023

• Add Mistral 7B to `test_models` (#1366)

  WoosukKwon

  authored
  9524867View commit details

  Copy full SHA for 9524867

  View code at this pointBrowse repository at this point

Commits on Oct 16, 2023

• Fix sampler test (#1379)

  WoosukKwon

  authored
  d3a5bd9View commit details

  Copy full SHA for d3a5bd9

  View code at this pointBrowse repository at this point

• Implement prompt logprobs & Batched topk for computing logprobs (#1328)

  Show description for 9d9072a
  

  zhuohan123

  and

  wanmok

  authored
  9d9072aView commit details

  Copy full SHA for 9d9072a

  View code at this pointBrowse repository at this point

• Implement PagedAttention V2 (#1348)

  WoosukKwon

  authored
  928de46View commit details

  Copy full SHA for 928de46

  View code at this pointBrowse repository at this point

Commits on Oct 2, 2023

• TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)

  zhuohan123

  authored
  ba0bfd4View commit details

  Copy full SHA for ba0bfd4

  View code at this pointBrowse repository at this point

Commits on Sep 28, 2023

• Fix OOM in attention kernel test (#1223)

  WoosukKwon

  authored
  6f88f76View commit details

  Copy full SHA for 6f88f76

  View code at this pointBrowse repository at this point

Commits on Sep 27, 2023

• Allocate more shared memory to attention kernel (#1154)

  Yard1

  authored
  cf5cb1eView commit details

  Copy full SHA for cf5cb1e

  View code at this pointBrowse repository at this point

Commits on Sep 23, 2023

• [Sampler] Vectorized sampling (simplified) (#1048)

  Show description for 947b794
  

  zhuohan123

  and

  Yard1

  authored
  947b794View commit details

  Copy full SHA for 947b794

  View code at this pointBrowse repository at this point

Commits on Sep 17, 2023

• Remove AsyncLLMEngine busy loop, shield background task (#1059)

  Yard1

  authored
  ff36139View commit details

  Copy full SHA for ff36139

  View code at this pointBrowse repository at this point

Commits on Sep 14, 2023

• Fix detokenization leaving special tokens (#1044)

  Show description for dd54a4b
  Yard1

  authored
  dd54a4bView commit details

  Copy full SHA for dd54a4b

  View code at this pointBrowse repository at this point

Commits on Sep 13, 2023

• Use TGI-like incremental detokenization (#984)

  Yard1

  authored
  9841d48View commit details

  Copy full SHA for 9841d48

  View code at this pointBrowse repository at this point

Commits on Sep 11, 2023

• Use FP32 in RoPE initialization (#1004)

  Show description for e67b4f2
  

  WoosukKwon

  and

  imoneoi

  authored
  e67b4f2View commit details

  Copy full SHA for e67b4f2

  View code at this pointBrowse repository at this point

Commits on Sep 8, 2023

• Start background task in `AsyncLLMEngine.generate` (#988)

  Show description for 0804384
  

  Yard1

  and

  zhuohan123

  authored
  0804384View commit details

  Copy full SHA for 0804384

  View code at this pointBrowse repository at this point

Commits on Sep 7, 2023

• [FIX] Fix Alibi implementation in PagedAttention kernel (#945)

  Show description for db09d4a
  

  3 peopleauthored
  db09d4aView commit details

  Copy full SHA for db09d4a

  View code at this pointBrowse repository at this point

• Make `AsyncLLMEngine` more robust & fix batched abort (#969)

  Show description for c07ece5
  

  Yard1

  and

  avnishn

  authored
  c07ece5View commit details

  Copy full SHA for c07ece5

  View code at this pointBrowse repository at this point

Commits on Sep 6, 2023

• [BugFix] Implement RoPE for GPT-J (#941)

  WoosukKwon

  authored
  320a622View commit details

  Copy full SHA for 320a622

  View code at this pointBrowse repository at this point

• Use queue for finished requests (#957)

  Yard1

  authored
  c9927c1View commit details

  Copy full SHA for c9927c1

  View code at this pointBrowse repository at this point

Commits on Sep 5, 2023

• Clean up kernel unit tests (#938)

  WoosukKwon

  authored
  fbd80adView commit details

  Copy full SHA for fbd80ad

  View code at this pointBrowse repository at this point

• Align vLLM's beam search implementation with HF generate (#857)

  zhuohan123

  authored
  002800fView commit details

  Copy full SHA for 002800f

  View code at this pointBrowse repository at this point

Commits on Sep 1, 2023

• Add tests for models (#922)

  WoosukKwon

  authored
  32b6816View commit details

  Copy full SHA for 32b6816

  View code at this pointBrowse repository at this point

Commits on Aug 30, 2023

• use flash-attn via xformers (#877)

  tmm1

  authored
  7547138View commit details

  Copy full SHA for 7547138

  View code at this pointBrowse repository at this point

Commits on Aug 22, 2023

• Implement approximate GELU kernels (#828)

  WoosukKwon

  authored
  d64bf16View commit details

  Copy full SHA for d64bf16

  View code at this pointBrowse repository at this point

Commits on Jul 25, 2023

• Fix paged attention testing. (#495)

  Show description for d7a1c6d
  shanshanpt

  authored
  d7a1c6dView commit details

  Copy full SHA for d7a1c6d

  View code at this pointBrowse repository at this point

Commits on Jul 18, 2023

• hotfix attn alibi wo head mapping (#496)

  Show description for bda41c7
  

  Oliver-ss

  and

  oliveryuan

  authored
  bda41c7View commit details

  Copy full SHA for bda41c7

  View code at this pointBrowse repository at this point

Commits on Jul 9, 2023

• [Model] Add support for GPT-J (#226)

  Show description for c894836
  

  AndreSlavescu

  and

  WoosukKwon

  authored
  c894836View commit details

  Copy full SHA for c894836

  View code at this pointBrowse repository at this point

Commits on Jul 3, 2023

• Add support for BLOOM (#331)

  WoosukKwon

  authored
  e41f067View commit details

  Copy full SHA for e41f067

  View code at this pointBrowse repository at this point

• [Quality] Add code formatter and linter (#326)

  zhuohan123

  authored
  d6fa1beView commit details

  Copy full SHA for d6fa1be

  View code at this pointBrowse repository at this point

Commits on Jun 17, 2023

• Change the name to vLLM (#150)

  WoosukKwon

  authored
  0b98ba1View commit details

  Copy full SHA for 0b98ba1

  View code at this pointBrowse repository at this point

Commits on Jun 7, 2023

• Support FP32 (#141)

  WoosukKwon

  authored
  e38074bView commit details

  Copy full SHA for e38074b

  View code at this pointBrowse repository at this point

Commits on May 24, 2023

• Add contributing guideline and mypy config (#122)

  WoosukKwon

  authored
  a283ec2View commit details

  Copy full SHA for a283ec2

  View code at this pointBrowse repository at this point

Commits on May 18, 2023

• Use pytest format for unit tests (#107)

  WoosukKwon

  authored
  825d889View commit details

  Copy full SHA for 825d889

  View code at this pointBrowse repository at this point