[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)

Jellyfin Server/Web packaging and release workflows

Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.

Materials for learning SGLang

TensorRT LLM Benchmark Configuration

SGLang is a fast serving framework for large language models and vision language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

Generative Models by Stability AI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

The macOS & iOS file archiver

Primary Git Repository for the Zephyr Project. Zephyr is a new generation, scalable, optimized, secure RTOS for multiple hardware architectures.

Primary Git Repository for the Zephyr Project. Zephyr is a new generation, scalable, optimized, secure RTOS for multiple hardware architectures.

Inference Llama 2 in one file of pure C

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

LLM training in simple, raw C/CUDA

LLM101n: Let's build a Storyteller

The sassy UML diagram renderer

A curated collection of diagramming tools used by leading software engineering teams

Linux sources

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

Generate types and converters from JSON, Schema, and GraphQL

Handlebars for golang

The definitive Web UI for local AI, with powerful features and easy setup.

LLM inference in C/C++

An open source, offline capable, mind mapping application leveraging HTML5 technologies