Pinned Loading

1. paddler paddler Public

   Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simpl…

   Rust 1.6k 91

2. llmops-handbook llmops-handbook Public

   Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

   CSS 82 7