🎯
Highlights
- Pro
Lists (1)
Stars
8
results
for sponsorable starred repositories
written in Python
Clear filter
A high-throughput and memory-efficient inference and serving engine for LLMs
The definitive Web UI for local AI, with powerful features and easy setup.
Accessible large language models via k-bit quantization for PyTorch.
PyTorch Implementation of Fully Convolutional Networks. (Training code to reproduce the original result is available.)
Official repository for LongChat and LongEval
https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching
Measure and optimize the energy consumption of your AI applications!