⚒️ AlphaTrion is an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Kubernetes-native Job Queueing

Production-Grade Container Scheduling and Management