LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

Ghidra is a software reverse engineering (SRE) framework

Universal LLM Deployment Engine with ML Compilation

Run compilers interactively from your web browser and interact with the assembly

A General-purpose Task-parallel Programming System using Modern C++

Angrave's Crowd-Sourced System Programming Book used at UIUC

Performance-portable, length-agnostic SIMD with runtime dispatch

The fastest and most memory efficient lattice Boltzmann CFD software, running on all GPUs and CPUs via OpenCL. Free for non-commercial use.

v4l2-loopback device

earlyoom - Early OOM Daemon for Linux

A retargetable MLIR-based machine learning compiler and runtime toolkit.

ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

Implementations of SIMD instruction sets for systems which don't natively support them.

List of awesome open source hardware tools, generators, and reusable designs

Faking your webcam background under GNU/Linux, now supports background blurring, animated background, colour map effect, hologram effect and on-demand processing.

Apple AMX Instruction Set

Basic linear algebra subroutines for embedded optimization

Flexible OpenSource firmware for TongSheng TSDZ2 mid drive ebike motor

oneAPI Specification source files

High-Performance Tensor Transpose library

Performance-portable version of the Athena++ astrophysical AMR-MHD code using Kokkos.

Main GAMER repository

Tensor Tiling Library

Running linear algebra as fast as possible on Apple silicon

The Farm-SVE package provides a header that implements the ARM C language extensions (ACLE) for the ARM Scalable Vector Extension (SVE) in standard C++.

Multilevel Optimized Matrix-matrix Multiplication Sandbox