LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

An open-source C++ library developed and used at Facebook.

Record and Replay Framework

Performance-portable, length-agnostic SIMD with runtime dispatch

Lightning fast C++/CUDA neural network framework

A full-featured utility for managing Windows Subsystem for Linux (WSL)

C++ implementation of the Python Numpy library

Learning FPGA, yosys, nextpnr, and RISC-V

The compiler is available for download. Get it!

Document Scanner that protects your privacy

XLS: Accelerated HW Synthesis

An efficient C++20 GPU numerical computing library with Python-like syntax

Silice is an easy-to-learn, powerful hardware description language, that simplifies designing hardware algorithms with parallelism and pipelines.

Raspberry Pi guitar pedal using neural networks to emulate real amps and effects.

dabnn is an accelerated binary neural networks inference framework for mobile platform

A low latency guitar effects processor suitable for running on a raspberry pi

Run Time for AIE and FPGA based platforms

BanditPAM C++ implementation and Python package

Fast Recurrent Networks Library

Fast multi-thread FEC simulator & library of efficient digital communication algorithms for SDR.

DLPrimitives/OpenCL out of tree backend for pytorch

Caffe fork that supports Fast R-CNN

HLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs

A stand-alone implementation of several NumPy dtype extensions used in machine learning.

A collection of extensions for Vitis and Intel FPGA OpenCL to improve developer quality of life.

Caffe for YOLO

Vitis HLS Library for FINN

Data Augmentation for Caffe