-
Notifications
You must be signed in to change notification settings - Fork 777
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
License
xorbitsai/inference
About
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Topics
Resources
License
Code of conduct
Stars
Watchers
Forks
Packages 0
No packages published