An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

Bitcoin Core integration/staging tree

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

A library for efficient similarity search and clustering of dense vectors.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Solidity, the Smart Contract Programming Language

Ceph is a distributed object, block, and file storage platform

A toolkit for making real world machine learning and data analysis applications in C++

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

Tiny data-over-sound library

Facebook AI Research's Automatic Speech Recognition Toolkit

Transformer related optimization, including BERT, GPT

🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.

My C++ Code for LeetCode OJ

A fast communication-overlapping library for tensor/expert parallelism on GPUs.

Qt5/C++ FFmpeg Media Converter

Boost.org python module

💻 Solutions to coding problems from popular platforms in multiple programming languages.

Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.