Real-time performance monitoring, done right!

Qwen3.8 Flash-Next SM120 TP2 packed-PLE and vision patches, reproducible build and deployment

MCP server created for Freshdesk, allowing AI models to interact with Freshdesk modules

Test data and fixtures for the Netdata Agent

Development repository for the Triton language and compiler

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downs…

RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink

Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)

38 editorial diagram types for Claude Code, Codex, and Pi. Self-contained HTML + SVG. No shadows. No Mermaid slop.

DeepGEMM: clean and efficient BLAS kernel library on GPU

The Network UPS Tools repository. UPS management protocol Informational RFC 9271 published by IETF at https://www.rfc-editor.org/info/rfc9271 Please star NUT on GitHub, this helps with sponsorships!

High-performance single-GPU inference for selected model checkpoints and GPUs.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context lengths. Supports SGLang and vLLM engines.

FlashInfer: Kernel Library for LLM Serving

An ultra-fast, distributed Safetensors loader

A high-throughput and memory-efficient inference and serving engine for LLMs

netflow_parser

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

⚙️ A Model Context Protocol (MCP) that provides tools for fetching and creating Reddit content

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthr…

👻 Ghostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.

A firewall for humans...