Building ML Systems @ UIUC
- Urbana, Illinois
-
02:04
(UTC -12:00) - https://kartikramesh.com
Highlights
- Pro
-
sglang-upstream Public
Forked from sgl-project/sglangSGLang is a fast serving framework for large language models and vision language models.
Python Apache License 2.0 UpdatedDec 3, 2025 -
nixl Public
Forked from ai-dynamo/nixlNVIDIA Inference Xfer Library (NIXL)
C++ Apache License 2.0 UpdatedDec 2, 2025 -
-
llm-d-kv-cache-manager Public
Forked from llm-d/llm-d-kv-cacheDistributed KV cache coordinator
Go Apache License 2.0 UpdatedNov 22, 2025 -
-
-
vllm Public
Forked from vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs
Python Apache License 2.0 UpdatedOct 20, 2025 -
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
seq-chat-rap-generator Public
A multi-agent system that generates a rap verse in the style of a hip hop artist
Python UpdatedJan 14, 2025 -
autogen Public
Forked from microsoft/autogenA programming framework for agentic AI 🤖
Python Creative Commons Attribution 4.0 International UpdatedJan 11, 2025 -
Previous Next