Stars
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Outline Client and Manager, developed by Jigsaw. Outline Manager makes it easy to create your own VPN server. Outline Client lets you share access to your VPN with anyone in your network, giving th…
Open source AI terminal for cloud and infrastructure management, enabling you to deploy, troubleshoot, and automate services using natural language and intelligent agents.
Golang gRPC Middlewares: interceptor chaining, auth, logging, retries and more.
Orion - Cloud-native high-performance proxy implemented in Rust attempting to be a drop in replacement for Envoy Proxy
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
A flexible, high-performance serving system for machine learning models
Extremely fast Query Engine for DataFrames, written in Rust
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
Dynamically provisioning persistent local storage with Kubernetes
🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platfor…
FUSE-based file system backed by Amazon S3
SGLang is a high-performance serving framework for large language models and multimodal models.
A Cloud Native Batch System (Project under CNCF)
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources
SDK for building Kubernetes applications. Provides high level APIs, useful abstractions, and project scaffolding.
Fast and Accurate ML in 3 Lines of Code
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
go-task / slim-sprig
Forked from Masterminds/sprigUseful template functions for Go templates.