All pull requests

Pull requests

• fix(qwen3.5): capture logprobs on the prefill draw when the think block is prefilled

  #780·manueldomke opened Oct 12, 2026·1 task done·

  ·

• perf(qwen3.5): prefill the empty think block for single-turn models

  #779·manueldomke opened Oct 12, 2026·1 task done·

  ·

• fix(qwen3.5): stop at max_tokens instead of one token past it

  #778·manueldomke opened Oct 12, 2026·1 task done·

  ·

• feat(server): report logprobs when the request asks for them

  #777·manueldomke opened Oct 12, 2026·1 task done·

  ·

• fix: don't count a discarded sample as generated text

  #776·manueldomke opened Oct 12, 2026·1 task done·

  ·

• feat(rai): move to ryzenai-corelib 0.29.2, add Qwen3.6-35B-A3B, run corelib's models behind one engine

  #774·chizamd opened Oct 11, 2026Contributor·3 tasks·

  ·

• chore: add security scanning workflows

  #754·haribabug opened Sep 24, 2026·

  ·

• fix: drop a tool call that generation never finished

  #742·Javinator9889 opened Sep 18, 2026Contributor·

  ·
  1

  1

• fix: split the think block in non-streaming responses

  #740·Javinator9889 opened Sep 18, 2026Contributor·

  ·
  1

  1

• fix: send SSE headers before prefill and beat during it

  #735·Javinator9889 opened Sep 17, 2026Contributor·

  ·
  1

• fix: let an unchanged conversation hit the prompt cache

  #734·Javinator9889 opened Sep 17, 2026Contributor·

  ·
  2

• feat: granite 4.2 - kernels

  #701·vegah opened Sep 2, 2026·

  ·
  1

• feat: granite 4.2

  #700·vegah opened Sep 2, 2026·

  ·

• whisper: don't force a timestamp after 16 tokens — truncated every transcription (#698)

  #699·Anjielon opened Sep 1, 2026·

  ·
  1

  1

• docs(embeddinggemma): quantization is bf16, not Q4_1

  #693·Aitschend3251 opened Aug 30, 2026·

  ·
  5

• docs: remove stale OOC note from Gemma 4 benchmark

  #667·ei-grad opened Aug 12, 2026·1 task done·

  ·

• feat: start Qwen3-ASR support

  #654·sxwxs opened Aug 6, 2026·

  ·
  1

• fix: enforce OpenAI tool-choice contract

  #650·waw2637 opened Aug 4, 2026·

  ·
  1

  24

• feat(telemetry): add embedding token count usage

  #594·abn opened Jul 3, 2026·

  ·

• fix: add virtual destructor to npu_cmd to prevent heap corruption (affects v0.9.42+)

  #580·rmanicardi opened Jun 6, 2026·4 tasks·

  ·
  1

• fix: read flm_version directly when checking compatibility (#545)

  #571·istitov opened May 28, 2026·

  ·
  1

• Feat: improve downloads of models under unstable connections

  #549·stdevPavelmc opened May 13, 2026·

  ·
  1

• feat: add flm service subcommand for systemd integration

  #543·thunderbug1 opened May 7, 2026·5 of 16 tasks·

  ·
  1

• fix: ensure prompt cache is invalidated whenever KV cache is cleared

  #542·thunderbug1 opened May 6, 2026·2 of 6 tasks·

  ·
  1

  2

• fix: prevent segfault on OPTIONS preflight requests

  #539·thunderbug1 opened May 4, 2026·

  ·
  1

  1