A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

📡 TCP/UDP port redirector

Outline Client and Manager, developed by Jigsaw. Outline Manager makes it easy to create your own VPN server. Outline Client lets you share access to your VPN with anyone in your network, giving th…

Kafka library in Go

Open source AI terminal for cloud and infrastructure management, enabling you to deploy, troubleshoot, and automate services using natural language and intelligent agents.

Golang gRPC Middlewares: interceptor chaining, auth, logging, retries and more.

DRA Driver for NVIDIA GPUs

Orion - Cloud-native high-performance proxy implemented in Rust attempting to be a drop in replacement for Envoy Proxy

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

WebSocket reverse proxy handler for Go

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

A flexible, high-performance serving system for machine learning models

Extremely fast Query Engine for DataFrames, written in Rust

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

Dynamically provisioning persistent local storage with Kubernetes

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platfor…

FUSE-based file system backed by Amazon S3

SGLang is a high-performance serving framework for large language models and multimodal models.

A Cloud Native Batch System (Project under CNCF)

Kubernetes-native Job Queueing

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

PyIceberg

Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources

SDK for building Kubernetes applications. Provides high level APIs, useful abstractions, and project scaffolding.

Fast and Accurate ML in 3 Lines of Code

NVIDIA device plugin for Kubernetes

Parallel S3 and local filesystem execution tool.

💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline

Useful template functions for Go templates.