Stars
SGLang is a high-performance serving framework for large language models and multimodal models.
gmagogsfm / vllm
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
A performant and modular runtime for TensorFlow
A Python library that generates static type annotations by collecting runtime types
Unofficial curated list of resources and references for Kinesis keyboard enthusiasts
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
A retargetable MLIR-based machine learning compiler and runtime toolkit.
Multi Model Server is a tool for serving neural net models for inference
by ex-googlers, for ex-googlers - a lookup table of similar tech & services
My Solutions to Leetcode problems ! leetcode 算法题源代码 & Leetcode 互动编程项目
"Multi-Level Intermediate Representation" Compiler Infrastructure
An Open Source Machine Learning Framework for Everyone
A Java to iOS Objective-C translation tool and runtime.
Production-Grade Container Scheduling and Management
A book-in-progress about the Linux kernel and its insides.