Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 4k 679

2. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 290 312

3. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 221 113

4. llm-d/llm-d-async llm-d/llm-d-async Public

   Asynchronous Processor for Inference Gateway. Orchestrator of queues

   Go 12 32

5. llm-d/llm-d-infra llm-d/llm-d-infra Public

   repo for CI and infrastructure required to maintain llm-d org member repos

   Shell 2 30