🐒
Making AI Safer
Making AI Safer. Focus on LLM、RL、Infra
Stars
2
stars
written in C
Clear filter
Distribute and run LLMs with a single file.
Dynamic Memory Management for Serving LLMs without PagedAttention