Stars
SGLang is a high-performance serving framework for large language models and multimodal models.
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
基于 ChatGPT API 的划词翻译浏览器插件和跨平台桌面端应用 - Browser extension and cross-platform desktop application for translation based on ChatGPT API.
Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is the core components in Katalyst system, including multiple ag…
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
Kubernetes WithOut Kubelet - Simulates thousands of Nodes and Clusters.
🏕️ Reproducible development environment for humans and agents
Training and serving large-scale neural networks with auto parallelization.
Making large AI models cheaper, faster and more accessible
Crane is a FinOps Platform for Cloud Resource Analytics and Economics in Kubernetes clusters. The goal is not only to help users to manage cloud cost easier but also ensure the quality of applicati…
Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
Home of the Hierarchical Namespace Controller (HNC). Adds hierarchical policies and delegated creation to Kubernetes namespaces for improved in-cluster multitenancy.
🚦 Kubernetes-native Job Queueing and Scheduling
Home for Cluster API, a subproject of sig-cluster-lifecycle
PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance …
[CNCF Sandbox Project] Managing your Kubernetes clusters (including public, private, edge, etc.) as easily as visiting the Internet
A toolkit to run Ray applications on Kubernetes
OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development platform built upon OpenAIOS for enterprises to develop and …
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Product roadmap for Alibaba Cloud Container Services including ACK, ACR, ASK - Serverless K8S, ACK@Edge and ASM - Service Mesh
Prometheus instrumentation library for Go applications
A Device Plugin for Kubernetes, which exposes the CPU cores as consumable Devices to the Kubernetes scheduler.
OceanBase is the unified distributed database for the AI era — open-source, multi-model, one engine for your most demanding workloads.
Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration