A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

FlashInfer: Kernel Library for LLM Serving

Cookbook of SGLang - Recipe

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism etc. 🎉🎉

OpenMMLab's next-generation platform for general 3D object detection.

ספר מלא בעברית בנושאים של למידת מכונה ולמידה עמוקה

Implementation of "Perceptual Losses for Real-Time Style Transfer and Super-Resolution" in PyTorch

Introduction to Cryptocurrencies (HUJI Course #67513)

Official pyTorch implementation of "Dynamic-Net: Tuning the Objective Without Re-training for Synthesis Tasks" experiments