giq · open source
Multimodal Inference Queue for Workstations
On-premises inference management for workstation GPUs: language, speech, image models and more, plus your own modalities as plugins, sharing one or more cards.
- On-prem AI
- GPU scheduling
- Plugins
- Apache-2.0
See how it works