Stars
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Batch orchestration tool for large-scale LLM processing. Treats batch processing as a data pipeline with TUI monitoring, Monte Carlo simulation support, and AI-assisted pipeline development.
What happens in your browser, stays in your browser.