Stars
3
results
for sponsorable starred repositories
Clear filter
A framework for efficient model inference with omni-modality models
A high-throughput and memory-efficient inference and serving engine for LLMs