Starred repositories
A Datacenter Scale Distributed Inference Serving Framework
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
SGLang is a fast serving framework for large language models and vision language models.
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
🍻 A CLI workflow for the administration of macOS applications distributed as binaries
You like pytorch? You like micrograd? You love tinygrad! ❤️
Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
C++ Library Manager for Windows, Linux, and MacOS
Protocol Buffers - Google's data interchange format
Efficient Triton Kernels for LLM Training
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Positron, a next-generation data science IDE
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Ongoing research training transformer models at scale
Multi-platform high-performance compute language extension for Rust.
Flutter makes it easy and fast to build beautiful apps for mobile and beyond
A simple, performant and scalable Jax LLM!
Apache Superset is a Data Visualization and Data Exploration Platform
On-device AI across mobile, embedded and edge for PyTorch
An Open Source Machine Learning Framework for Everyone