xlite-dev
Develop ML/AI toolkits and ML/AI/CUDA Learning resources.
Pinned Loading
Repositories
Showing 10 of 77 repositories
- lite.ai.toolkit Public
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
- vllm-ascend Public Forked from vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
-
- Awesome-LLM-Inference Public
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- ffpa-attn Public Forked from vipshop/ffpa-attn
Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.
Top languages
Loading…
Most used topics
Loading…