Lists (21)
AI infra
Andriod
Such asAPI
Such asCompetition
You think I'm competing, but I'm waiting for open sourceDaily
Such asData science
Data analysis science is no funDeepLearning
Ha ha haDeploy
About deeplearning model deploymentEmbedded
About me playing with hardwareFun
🤖 GPT
Do't forgot meHalfStack
Do you long for full stack?Math
Math is allMatting
Such asPaddle
About PaddlePaddlePINN
Python 🐍
Rust 🦀
Rust tool
SNN
Swift
Stars
MobileFineTuner: Native C++ framework for fine-tuning LLMs directly on mobile devices. Features: LoRA/Full-FT, ZeRO-inspired parameter sharding, energy-aware throttling, custom autograd engine. Kee…
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
Publish Vega visualizations as embedded web components with interactive parameters.
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.
Efficient Triton Kernels for LLM Training
A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch
A curated list of papers, tools, and resources on Multi-Token Prediction (MTP) and related techniques in Large Language Models (LLMs), Speech-Language Models (SLMs), and more.
Typescript/React Library for AI Chat💬🚀
The agent that grows with you
A configurable agentic CLI running in terminal with tools, skills, file system access, web search, permission management, customized constitution. Use with both online API and local hosted instruct…
Remove unused Rust dependencies with this one weird trick!
Linux virtual machines, with a focus on running containers
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Python PyPi staging server and packaging, testing, release tool
⚡ A fast Git hook manager written in Rust, designed as a drop-in alternative to pre-commit, reimagined.
JavaScript library for conversion between TeX/LaTeX and Typst math code.
An open-source AI agent that brings the power of Gemini directly into your terminal.
A self hosted virtual browser that runs in docker and uses WebRTC.
An intuitive and low-overhead instrumentation tool for Python