Commits

Commit history

1. Commits on Jan 10, 2025

   • [Misc] Clean up debug code in Deepseek-V3 (#11930)

     Show description for 46fa98c
     Isotr0py

     authored
     46fa98cView commit details

     Copy full SHA for 46fa98c

     Browse repository at this point

   • [Hardware][CPU] Support MOE models on x86 CPU (#11831)

     Show description for aa1e77a
     bigPYJ1151

     authored
     aa1e77aView commit details

     Copy full SHA for aa1e77a

     Browse repository at this point

   • Doc fix in `benchmark_long_document_qa_throughput.py` (#11933)

     Show description for 5959564
     KuntaiDu

     authored
     5959564View commit details

     Copy full SHA for 5959564

     Browse repository at this point

   • [Docs] Fix docstring in `get_ip` function (#11932)

     Show description for f33e033
     KuntaiDu

     authored
     f33e033View commit details

     Copy full SHA for f33e033

     Browse repository at this point

   • [Doc] Rename offline inference examples (#11927)

     Show description for 482cdc4
     hmellor

     authored
     482cdc4View commit details

     Copy full SHA for 482cdc4

     Browse repository at this point

   • [platform] support custom torch.compile backend key (#11318)

     Show description for 20410b2
     

     wangxiyuan

     and

     youkaichao

     authored
     20410b2View commit details

     Copy full SHA for 20410b2

     Browse repository at this point

   • [Doc] [1/N] Initial guide for merged multi-modal processor (#11925)

     Show description for 12664dd
     DarkLight1337

     authored
     12664ddView commit details

     Copy full SHA for 12664dd

     Browse repository at this point

   • [ci] Fix sampler tests (#11922)

     Show description for 241ad7b
     youkaichao

     authored
     241ad7bView commit details

     Copy full SHA for 241ad7b

     Browse repository at this point

   • Replace "online inference" with "online serving" (#11923)

     Show description for d85c47d
     hmellor

     authored
     d85c47dView commit details

     Copy full SHA for d85c47d

     Browse repository at this point

   • [platform] support pytorch custom op pluggable (#11328)

     Show description for ef725fe
     wangxiyuan

     authored
     ef725feView commit details

     Copy full SHA for ef725fe

     Browse repository at this point

   • [misc] remove python function call for custom activation op (#11885)

     Show description for d907be7
     

     cennn

     and

     youkaichao

     authored
     d907be7View commit details

     Copy full SHA for d907be7

     Browse repository at this point

   • [ci] fix gh200 tests (#11919)

     Show description for d53575a
     youkaichao

     authored
     d53575aView commit details

     Copy full SHA for d53575a

     Browse repository at this point

   • [BUGFIX] Fix `UnspecifiedPlatform` package name (#11916)

     Show description for 61af633
     jikunshang

     authored
     61af633View commit details

     Copy full SHA for 61af633

     Browse repository at this point

   • [Bugfix] Validate lora adapters to avoid crashing server (#11727)

     Show description for ac2f3f7
     

     joerunde

     and

     jeejeelee

     authored
     ac2f3f7View commit details

     Copy full SHA for ac2f3f7

     Browse repository at this point

   • [torch.compile] Hide KV cache behind torch.compile boundary (#11677)

     Show description for cf5f000
     heheda12345

     authored
     cf5f000View commit details

     Copy full SHA for cf5f000

     Browse repository at this point

   • [Doc] Show default pooling method in a table (#11904)

     Show description for 3de2b1e
     DarkLight1337

     authored
     3de2b1eView commit details

     Copy full SHA for 3de2b1e

     Browse repository at this point

   • [VLM] Enable tokenized inputs for merged multi-modal processor (#11900)

     Show description for b844b99
     DarkLight1337

     authored
     b844b99View commit details

     Copy full SHA for b844b99

     Browse repository at this point

   • [Doc][5/N] Move Community and API Reference to the bottom (#11896)

     Show description for c3cf54d
     

     DarkLight1337

     and

     simon-mo

     authored
     c3cf54dView commit details

     Copy full SHA for c3cf54d

     Browse repository at this point
2. Commits on Jan 9, 2025

   • [Docs] Add Modal to deployment frameworks (#11907)

     charlesfrye

     authored
     36f5303View commit details

     Copy full SHA for 36f5303

     Browse repository at this point

   • [Misc] Provide correct Pixtral-HF chat template (#11891)

     Show description for 9a22834
     DarkLight1337

     authored
     9a22834View commit details

     Copy full SHA for 9a22834

     Browse repository at this point

   • [ci]try to fix flaky multi-step tests (#11894)

     Show description for bd82872
     youkaichao

     authored
     bd82872View commit details

     Copy full SHA for bd82872

     Browse repository at this point

   • [platform] Allow platform specify attention backend (#11609)

     Show description for 405eb8e
     

     wangxiyuan

     and

     MengqingCao

     authored
     405eb8eView commit details

     Copy full SHA for 405eb8e

     Browse repository at this point

   • [Doc] Add model development API Reference (#11884)

     Show description for 65097ca
     DarkLight1337

     authored
     65097caView commit details

     Copy full SHA for 65097ca

     Browse repository at this point

   • [Bugfix] fix beam search input errors and latency benchmark script (#11875)

     Show description for 1d967ac
     

     yeqcharlotte

     and

     yeq

     authored
     1d967acView commit details

     Copy full SHA for 1d967ac

     Browse repository at this point

   • [Bugfix] Override dunder methods of placeholder modules (#11882)

     Show description for 0bd1ff4
     DarkLight1337

     authored
     0bd1ff4View commit details

     Copy full SHA for 0bd1ff4

     Browse repository at this point

   • [perf]fix current stream (#11870)

     Show description for 310aca8
     youkaichao

     authored
     310aca8View commit details

     Copy full SHA for 310aca8

     Browse repository at this point

   • [Doc] Intended links Python multiprocessing library (#11878)

     guspan-tanadi

     authored
     a732900View commit details

     Copy full SHA for a732900

     Browse repository at this point

   • [Misc] Move `print_*_once` from utils to logger (#11298)

     Show description for d848800
     

     DarkLight1337

     and

     mfournioux

     authored
     d848800View commit details

     Copy full SHA for d848800

     Browse repository at this point

   • [Doc] Recommend uv and python 3.12 for quickstart guide (#11849)

     Show description for 730e959
     mgoin

     authored
     730e959View commit details

     Copy full SHA for 730e959

     Browse repository at this point

   • treat do_lower_case in the same way as the sentence-transformers library (#11815)

     Show description for 1fe554b
     maxdebayser

     authored
     1fe554bView commit details

     Copy full SHA for 1fe554b

     Browse repository at this point

   • [CI] Turn on basic correctness tests for V1 (#10864)

     tlrmchlsmth

     authored
     615e4a5View commit details

     Copy full SHA for 615e4a5

     Browse repository at this point
3. Commits on Jan 8, 2025

   • [Docs] Add Google Cloud Meetup (#11864)

     simon-mo

     authored
     3db0cafView commit details

     Copy full SHA for 3db0caf

     Browse repository at this point

   • [Kernel][Triton][AMD] Use block size heuristic for avg 2.8x speedup for int8 models (#11698)

     Show description for 526de82
     rasmith

     authored
     526de82View commit details

     Copy full SHA for 526de82

     Browse repository at this point

   • [TPU][Quantization] TPU `W8A8` (#11785)

     Show description for 56fe4c2
     

     robertgshaw2-redhat

     and

     WoosukKwon

     authored
     56fe4c2View commit details

     Copy full SHA for 56fe4c2

     Browse repository at this point

   • [Misc]add some explanations for BlockHashType (#11847)

     WangErXiao

     authored
     47de882View commit details

     Copy full SHA for 47de882

     Browse repository at this point