CUDA 算子手撕与面试指南

Machine Learning Engineering Open Book

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

The best ChatGPT that $100 can buy.

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Nano vLLM

Nano vLLM Triton

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

LLM training in simple, raw C/CUDA

Fast and memory-efficient exact attention

Tensor library for machine learning

LLM inference in C/C++

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

A comprehensive guide for beginners in the field of data management and artificial intelligence.

Neural Networks: Zero to Hero

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Video+code lecture on building nanoGPT from scratch

The simplest, fastest repository for training/finetuning medium-sized GPTs.

MLIR For Beginners tutorial

AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

✔（已完结）最全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

《代码随想录》LeetCode 刷题攻略：200道经典题目刷题顺序，共60w字的详细图解，视频难点剖析，50余张思维导图，支持C++，Java，Python，Go，JavaScript等多语言版本，从此算法学习不再迷茫！🔥🔥 来看看，你会发现相见恨晚！🚀

校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step