Stars
This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, s…
vLLM Kunlun (vllm-kunlun) is a community-maintained hardware plugin designed to seamlessly run vLLM on the Kunlun XPU.
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
My learning notes for ML SYS.
Bibtex for Sparsity in Deep Learning paper (https://arxiv.org/abs/2102.00554) - open for pull requests
6.S081课程全记录,包括课程使用的书籍、论文、实验要求的中文翻译,以及实验过程记录
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
[DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations
python implementation of efficient convolution operators for tracking
c++ visual studio implement of ECO: Efficient Convolution Operators for Tracking
Visual tracking library based on PyTorch.
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-…
PyTorch ,ONNX and TensorRT implementation of YOLOv4
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
A Python implementation of global optimization with gaussian processes.
The deep-learning framework Caffe that support faster-rcnn and RFCN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its…
OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 BSD version.
Simple Encoder, Generator and Face Modificator with StyleGAN2
Progressive Growing of GANs for Improved Quality, Stability, and Variation
Awesome paper list with code about generative adversarial nets