Starred repositories
My learning notes for ML SYS.
A high-throughput and memory-efficient inference and serving engine for LLMs
xoreaxeaxeax / movfuscator
Forked from Battelle/movfuscatorThe single instruction C compiler
View a Git Graph of your repository in Visual Studio Code, and easily perform Git actions from the graph.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
by ex-googlers, for ex-googlers - a lookup table of similar tech & services
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
Voyager is a C++ non-blocking network library which can run on Linux, Mac OS X, FreeBSD, etc.
A high-availability, high-throughput and highly reliable distributed queue based on the Paxos algorithm.
The Paxos library implemented in C++ that has been used in the WeChat production environment.
FedML - The Research and Production Integrated Federated Learning Library: https://fedml.ai
An Industrial Grade Federated Learning Framework
[ARCHIVED] Cooperative primitives for CUDA C++. See https://github.com/NVIDIA/cccl
Build NVIDIA® CUDA™ code for OpenCL™ 1.2 devices
A fast JSON parser/generator for C++ with both SAX/DOM style API
An authorization library that supports access control models like ACL, RBAC, ABAC in Frontend Javascript
pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding a…