Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
fp8
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
ZYFA Beats AITER on FP8 Attention Speed and Accuracy
Shaam
Shaam
Shaam
Follow
Nov 11
ZYFA Beats AITER on FP8 Attention Speed and Accuracy
#
zyfa
#
aiter
#
fp8
#
amdmi355x
Comments
Add Comment
6 min read
Moderation
llm-compressor for vLLM: The FP8/AWQ Deployment Tradeoff
Jangwook Kim
Jangwook Kim
Jangwook Kim
Follow
Nov 10
llm-compressor for vLLM: The FP8/AWQ Deployment Tradeoff
#
quantization
#
vllm
#
fp8
#
awq
Comments
Add Comment
9 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account