Starred repositories
Codex skill and Rust DataFusion converter for exporting Nsight Systems reports to Perfetto JSON
Easily and securely send things from one computer to another 🐊 📦
Artifact README for MCon, an Elastic Mobile Container architecture
SemaTune is a host-side Linux autotuning framework that measures workloads powered by LLMs.
An agentic skills framework & software development methodology that works.
[ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Causal Parallel Tree Drafting
DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms
let coding agents use ncu skills analysis cuda program automatically!
Agent skill that removes signs of AI-generated writing from text
Framework for evaluating and improving agents
Agentic Kernel Optimization for All — automated GPU kernel optimization for any kernel, any hardware, any language
Daily Arxiv Papers on LLM Systems
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
[NeurIPS 2025 Spotlight] OpenCUA: Open Foundations for Computer-Use Agents
Agent S: an open agentic framework that uses computers like a human
τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
A simple, fast and robust program-aware agentic inference system.
Tongyi Deep Research, the Leading Open-source Deep Research Agent
Fast and memory-efficient exact attention