Fast container image distribution plugin with lazy pulling

Kata Containers is an open source project and community working to build a standard implementation of lightweight Virtual Machines (VMs) that feel and perform like containers, but provide the workl…

Nydus - the Dragonfly image service, providing fast, secure and easy access to container images.

FlashInfer: Kernel Library for LLM Serving

Rust method delegation with less boilerplate

Utilities for working with bytes

The SPIFFE Runtime Environment

Hercules is the world’s first open-source testing agent, enabling UI, API, Security, Accessibility, and Visual validations – all without code or maintenance. Automate testing effortlessly and let H…

The open LLM Ops platform - Traces, Analytics, Evaluations, Datasets and Prompt Optimization ✨

A Datacenter Scale Distributed Inference Serving Framework

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

The ultimate Python library in building OAuth, OpenID Connect clients and servers. JWS, JWE, JWK, JWA, JWT included.

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Fast serverless LLM inference, in Rust.

Minimalist ML framework for Rust

Specification and documentation for the Model Context Protocol

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

The Apache Tika toolkit detects and extracts metadata and text from over a thousand different file types (such as PPT, XLS, and PDF).

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Open CoreUI - A rewritten Open WebUI in Rust, significantly reducing memory and resource usage, requiring no dependency services, no Docker, with both a server version and a Tauri-based desktop cli…

in-toto Attestation Framework

LLM inference in C/C++

A fast bump allocation arena for Rust

Containers for machine learning

OpenTelemetry Collector

Open-source search and retrieval database for AI applications.

Get your documents ready for gen AI

Real-Time Interrupt-driven Concurrency (RTIC) framework for ARM Cortex-M microcontrollers

Code signing and transparency for containers and binaries