-
Systems Group @ ETH Zurich
- Zürich
- https://www.linkedin.com/in/yong-jun-he-762485154/
Stars
Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models
Credo: Declarative Control of LLM Pipelines via Beliefs and Policies (VLDB 2026 Demo)
An In-Depth Study of Filter-Agnostic Vector Search on a PostgreSQL Database System (SIGMOD 2026)
Communication patterns for AI, built on top of NCCL device and host APIs
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
InfiniCCL is a unified, cross-platform collective communication library designed for heterogeneous accelerator environments.
SGLang is a high-performance serving framework for large language models and multimodal models.
DeepEP: an efficient expert-parallel communication library
Google Research
LLM Inference analyzer for different hardware platforms
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
Extremely fast Query Engine for DataFrames, written in Rust
Development repository for the Triton language and compiler
NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process communication and coordination overheads by allowing programmer…
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
Low-Latency Transaction Scheduling via Userspace Interrupts: Why Wait or Yield When You Can Preempt? (SIGMOD 2025 Best Paper Award)
Pytorch domain library for recommendation systems
Graph Neural Network Library for PyTorch
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
Fast and memory-efficient exact attention
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.