Stars
Petals ⭐
LLMs
2 repositories
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client