An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

Tensor library for machine learning

FlashMLA: Efficient Multi-head Latent Attention Kernels

High-speed Large Language Model Serving for Local Deployment

Diffusion model(SD,Flux,Wan,Qwen Image,...) inference in pure C/C++

c++ implementation of the LBFGS optimization algorithm