FlashInfer: Kernel Library for LLM Serving

Use Hugging Face with JavaScript

The open source coding agent.

A high-throughput and memory-efficient inference and serving engine for LLMs

Supercharge Your LLM with the Fastest KV Cache Layer

SearXNG is a free internet metasearch engine which aggregates results from various search services and databases. Users are neither tracked nor profiled.

SGLang is a fast serving framework for large language models and vision language models.

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

WebRTC Implementation for TypeScript (Node.js), includes ICE/DTLS/SCTP/RTP/SRTP

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

mirror of git://source.ffmpeg.org/ffmpeg.git

LLM inference in C/C++

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

YOLOv12: Attention-Centric Real-Time Object Detectors

Unofficial API for Ring Doorbells, Cameras, Alarm System, and Smart Lighting

Beautiful static documentation for your API

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-fri…