Skip to content
View ai-hpc's full-sized avatar
🦙
Research Inference Optimization & Confidential Computing
🦙
Research Inference Optimization & Confidential Computing

Organizations

@openclaw @FastCrest @cathedralai @gittensor-model-hub

Block or report ai-hpc

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Showing results

Inference Optimization by Economic Kernel Search

Python 4 2 Updated Nov 16, 2026

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

Python 1,705 203 Updated Nov 16, 2026

A framework for few-shot evaluation of language models.

Python 14,484 3,811 Updated Nov 4, 2026
Python 48 228 Updated Oct 12, 2026

Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.

C++ 93 82 Updated Oct 11, 2026

SDK for developing enclaves

C 1,214 381 Updated Nov 13, 2026

Go ahead and axolotl questions

Python 12,728 1,478 Updated Nov 13, 2026
Python 43 33 Updated Nov 16, 2026

CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation

Python 1,355 137 Updated Jul 8, 2026

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Python 1,834 305 Updated Nov 15, 2026

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python 12,374 2,168 Updated Nov 16, 2026

SGLang is a high-performance serving framework for large language models and multimodal models.

Python 38,941 10,529 Updated Nov 16, 2026

NanoCluster: Compact & Affordable Cluster for Everyone

227 9 Updated Jan 26, 2026

compiler learning resources collect.

Python 2,791 371 Updated May 20, 2026
Python 549 67 Updated Aug 26, 2026

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Python 3,666 328 Updated Jul 17, 2025

Real-Time VLAs via Future-state-aware Asynchronous Inference.

Python 522 34 Updated Apr 22, 2026

DFlash: Block Diffusion for Flash Speculative Decoding

Python 6,244 445 Updated Aug 18, 2026

CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

Python 258 24 Updated Nov 14, 2026

An Optimizer for Nvidia Compilers.

Python 148 17 Updated Nov 14, 2026

Daily ArXiv Papers.

Python 451 100 Updated Nov 5, 2026

A retargetable MLIR-based machine learning compiler and runtime toolkit.

C++ 4,016 1,059 Updated Nov 16, 2026

Development repository for the Triton language and compiler

MLIR 20,587 3,425 Updated Nov 16, 2026

TokenSpeed is a speed-of-light LLM inference engine.

Python 2,933 417 Updated Nov 16, 2026

FlyDSL is the Python front‑end of the project: a Flexible Layout Python DSL for expressing tiling, partitioning, data movement, and kernel structure at a high level.

Python 310 143 Updated Nov 16, 2026

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

Python 632 155 Updated Nov 13, 2026

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Jupyter Notebook 2,776 207 Updated Jun 25, 2024

Open Machine Learning Compiler Framework

Python 13,905 4,051 Updated Nov 15, 2026

All information and news with respect to Falcon-H1 series

129 18 Updated Oct 9, 2025

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Python 1,789 197 Updated Nov 16, 2026
Next