heuristic learning quant

SGLang-Omni empowers high-performance serving for TTS, ASR, speech and omni models.

Open-source Python library for reproducible deep learning in neuroimaging

AI Toolkit for Healthcare Imaging

云微WOC，云微信，自由连接

A throughput-oriented high-performance serving framework for LLMs

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

TokenSpeed is a speed-of-light LLM inference engine.

SGLang is a high-performance serving framework for large language models and multimodal models.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Ascend TileLang adapter

分享便宜靠谱Token，抹平信息差

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

AI API identity gateway — reverse proxy that normalizes device fingerprints and telemetry for privacy-preserving API proxying

AI agents running research on single-GPU nanochat training automatically adopted for MacOS

bash 基本用法指南

A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎，预测万物

Full-stack AI agent for coding, files, terminals, tools, research, content, multimodal work, and multi-agent workflows.

Mobile and Web client for Codex and Claude Code, with realtime voice, encryption and fully featured

A Datacenter Scale Distributed Inference Serving Framework

A static analyzer for Java, C, C++, and Objective-C

Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity.

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of…

CUDA Python: Performance meets Productivity

A list of AI autonomous agents

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants