Stars
Collection of Summer 2026 tech internships!
Post-training with Tinker
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…
📚 Collaborative cheatsheets for console commands
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a fast serving framework for large language models and vision language models.
𝗔𝗜-𝗡𝗮𝘁𝗶𝘃𝗲 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲. Blazing analytics, fast search, geo insights, vector AI. Built for multimodal analytics, Open-source Snowflake alternative. https://databend.com
#1 PDF Application on GitHub that lets you edit PDFs on any device anywhere
eBPF-based Networking, Security, and Observability
🎓 无需编写任何代码即可轻松创建漂亮的学术网站 Easily create a beautiful academic résumé or educational website using Hugo and GitHub. No code.
Development repository for the Triton language and compiler
An extremely fast Python package and project manager, written in Rust.
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
Hyprland is an independent, highly customizable, dynamic tiling Wayland compositor that doesn't sacrifice on its looks.
Now we have become very big, Different from the original idea. Collect premium software in various categories.
Paper Debugger is the best overleaf companion
Intelligent Router for Mixture-of-Models
Distributed transactional key-value database, originally created to complement TiDB
Streaming data platform. Real-time stream processing, low-latency serving, and Iceberg table management.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
A Datacenter Scale Distributed Inference Serving Framework
⚙️ All-in-One menu bar app, hide 💻MacBook Pro's notch, dark mode, AirPods, Shortcuts
🌟 Wiki of OI / ICPC for everyone. （某大型游戏线上攻略，内含炫酷算术魔法）
⚡A CLI tool for code structural search, lint and rewriting. Written in Rust