Skip to content

Pull requests: alibaba/rtp-llm

New pull request New
63 Open 315 Closed
63 Open 315 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: modify fp16 layernorm in PreLayers function
#493 opened Dec 24, 2025 by junna2016 Loading…
4
fix - support get dtype from attn in python
#492 opened Dec 24, 2025 by Nancheng-11 Loading…
Feature/weight mask
#491 opened Dec 24, 2025 by zhanghuanzj Loading…
1
feat: support trt paged attn
#490 opened Dec 24, 2025 by Vinkle-hzt Loading…
11
feat - remove reshape for deepgemm weight
#488 opened Dec 24, 2025 by alibaba-miji Loading…
hotfix: support multi merge copy for rocm mtp
#486 opened Dec 24, 2025 by liaocz Loading…
1
feat: adapt glm-4.7 reasoning parsing
#485 opened Dec 24, 2025 by soaringk Loading…
[WIP] Features/refactor endpoint
#483 opened Dec 23, 2025 by wanglining97 Loading…
12
[ROCm] feat: support bert and roberta model in python mode
#481 opened Dec 23, 2025 by muse-coder Loading…
8
Develop/backend refactor rebase
#480 opened Dec 22, 2025 by wanglining97 Loading…
9
feat: release cache store when quit
#479 opened Dec 22, 2025 by zhangchicc Loading…
[ROCm] feat: support custom all gather
#475 opened Dec 22, 2025 by yyccli Loading…
2
Feature/clean sample
#474 opened Dec 21, 2025 by LLLLKKKK Loading…
feat: support python-xqa with CUDA 12.9
#473 opened Dec 19, 2025 by qqbbiu Loading…
4
Feature/support qwen next
#472 opened Dec 19, 2025 by alibaba-miji Loading…
support fp4 moe for decode
#470 opened Dec 18, 2025 by LingYeAI Loading…
2
feat - add trt llm gen attention
#469 opened Dec 18, 2025 by zerozw Loading…
23
add virtual memory based allocator, detach & attach memory functions
#468 opened Dec 18, 2025 by ZhangZhiPku Loading…
fix: partial cpp smoke tp py model
#467 opened Dec 17, 2025 by JackTan25 Loading…
24
feat - refactor fmha python in cudagraph & adapt pymodel mla cudagraph
#463 opened Dec 17, 2025 by Nancheng-11 Loading…
10
fix: extra tokens after stop word and glm missing separator in tool call
#458 opened Dec 15, 2025 by soaringk Loading…
16
opt startup speed: reduce too long health check interval & move import in func
#456 opened Dec 15, 2025 by ABNER-1 Loading…
10
[draft] Features/refactor frontend
#452 opened Dec 15, 2025 by wanglining97 Loading…
9
Feat/refactor cuda graph ut
#450 opened Dec 15, 2025 by JackTan25 Loading…
17
Feature/flashinfer python merge
#448 opened Dec 12, 2025 by zerozw Loading…
17
ProTip! Follow long discussions with comments:>50.