xlite-dev
Pinned Loading
Repositories
- lite.ai.toolkit Public
A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion.
- LeetCUDA Public
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
- vllm-ascend Public Forked from vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
- diffusers Public Forked from huggingface/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
- cutlass Public Forked from NVIDIA/cutlass
CUDA Templates and Python DSLs for High-Performance Linear Algebra
- sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
- CuTe Public Forked from NVlabs/CuTe
Reference implementation and examples of the CuTe Layout representation and algebra.
- Awesome-LLM-Inference Public
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- ffpa-attn Public Forked from vipshop/ffpa-attn
Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.
Top languages
Loading…
Most used topics
Loading…