Stars
An open-source AI agent that brings the power of Gemini directly into your terminal.
The SBOM tool is a highly scalable and enterprise ready tool to create SPDX 2.2 compatible SBOMs for any variety of artifacts.
🍻 Default formulae for the missing package manager for macOS (or Linux)
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…
Linux OS for Azure 1P services and edge appliances
Production-Grade Container Scheduling and Management
Empowering everyone to build reliable and efficient software.
AWS Deep Learning Containers are pre-built Docker images that make it easier to run popular deep learning frameworks and tools on AWS.
AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud.
pytest fixture for benchmarking code
Deploy a Production Ready Kubernetes Cluster
Datasets, Transforms and Models specific to Computer Vision
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
The Microsoft Build Engine (MSBuild) is the build platform for .NET and Visual Studio.
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Watches files and records, or triggers actions, when they change.
A library OS for Linux multi-process applications, with Intel SGX support
A set of tools to keep your pinned Python dependencies fresh.
Informative site with EoL dates of everything
Enhancements tracking repo for Kubernetes
Run safety benchmarks against AI models and view detailed reports showing how well they performed.
Kubernetes community content
Achieve state of the art inference performance with modern accelerators on Kubernetes
A scalable inference server for models optimized with OpenVINO™