Tile-Based Runtime for Ultra-Low-Latency LLM Inference

An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

how to optimize some algorithm in cuda.

My learning notes for ML SYS.

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.

Cost-efficient and pluggable Infrastructure components for GenAI inference

Rust bindings for the Python interpreter

A fast, simple TUI for interacting with systemd services and their logs

红色警戒2源代码

Export helm stats into the Prometheus format

Rust async runtime based on io-uring.

Complete markdown parser in 1100 LOC; single file, zero dependencies

Kubernetes CSI Driver for serving OCI model artifacts

🐜 HMPL.js is a lightweight server-oriented template language for JavaScript. Fetch HTML, render it safely, and keep apps dynamic, modern, and small.

Window peeking, alt-tab and other enhancements for macOS

Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, i…

The best way to get AI coding agents to solve hard problems in complex codebases.

Implementing RL agents, one algorithm at a time

Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini

🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部保留在本地。支持DeepSeek，OpenAI， Ollama，LMStudio，AnythingLLM，硅基流动，火山方舟，阿里云百炼等平台或模型。

Language-agnostic AI auditor that autonomously builds and refines adaptive knowledge graphs for deep, iterative code reasoning.

(: SMILE! The positive prompt language for structured prompt engineering — used for complex prompts, multi-turn pipelines, agentic engineering. Modular & maintainable prompts for powerful Large Lan…

a tiling window manager for macos

Minimal, high-performance Python helpers for concurrent S3 object transfers

Nano vLLM