Skip to content

feat(tui): move provider detection to background threads for faster startup#554

Merged
AlexsJones merged 1 commit into
mainfrom
feat/async-provider-detection
May 17, 2026
Merged

feat(tui): move provider detection to background threads for faster startup#554
AlexsJones merged 1 commit into
mainfrom
feat/async-provider-detection

Conversation

@AlexsJones
Copy link
Copy Markdown
Owner

Summary

  • Moves all network-based provider detection (Ollama, MLX, Docker Model Runner, LM Studio, vLLM) to background threads instead of blocking TUI startup
  • App renders immediately after hardware detection; provider results stream in via mpsc channel and update the model list as each completes
  • Only llama.cpp detection remains synchronous (local filesystem check, fast)
  • Adds providers_loading flag to App for optional UI loading indicators

Test plan

  • cargo test — 366 passed, 0 failed
  • cargo clippy — no errors
  • Manual: launch TUI and verify models appear shortly after startup
  • Manual: verify installed model markers update correctly once providers finish detecting

…tartup

Provider detection (Ollama, MLX, Docker Model Runner, LM Studio, vLLM)
now runs in parallel background threads instead of blocking TUI startup.
The app renders immediately after hardware detection and provider results
stream in via mpsc channel, updating the installed model list as each
provider completes.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@AlexsJones AlexsJones merged commit 9e8308d into main May 17, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant