- 🔭 I’m currently working on LLM inference architecture development
- 🌱 Specializing in multi-GPU parallelism and model acceleration
- 💻 Proficient in C++, Python, and CUDA programming
- 🚀 Experienced in optimizing large-scale model inference
- 🧠 Supporting various model architectures for efficient deployment
- 💡 Passionate about pushing the boundaries of AI efficiency
Pinned Loading
-
alibaba/rtp-llm
alibaba/rtp-llm PublicRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.