Commits

Branch selector

 main

User selector

maxdebayser

All time

Commit History

Commits on Mar 16, 2026

• Add simple granite4 tool parser (#36827)

  Show description for 9f9ecff
  maxdebayser

  authored
  9f9ecff

  Copy full SHA for 9f9ecff

Commits on Jan 22, 2026

• Support bge-m3 sparse embeddings and colbert embeddings (#14526)

  Show description for ff365ee
  maxdebayser

  authored
  ff365ee

  Copy full SHA for ff365ee

Commits on Oct 14, 2025

• Add support for the /rerank endpoint in vllm bench serve (#26602)

  Show description for fe3edb4
  maxdebayser

  authored
  fe3edb4

  Copy full SHA for fe3edb4

Commits on Oct 13, 2025

• Add tests for chunked prefill and prefix cache with causal pooling models (#26526)

  Show description for d8bebb0
  

  maxdebayser

  and

  ArkVex

  authored
  d8bebb0

  Copy full SHA for d8bebb0

Commits on Oct 5, 2025

• Add documentation for granite 4 tool calling (#26175)

  Show description for e0986ea
  maxdebayser

  authored
  e0986ea

  Copy full SHA for e0986ea

Commits on Sep 20, 2025

• Don't skip special tokens with hermes-style tool calling (#25281)

  Show description for a36c675
  maxdebayser

  authored
  a36c675

  Copy full SHA for a36c675

Commits on Sep 12, 2025

• Enable conversion of multimodal models to pooling tasks (#24451)

  Show description for e090b7b
  maxdebayser

  authored
  e090b7b

  Copy full SHA for e090b7b

Commits on Sep 2, 2025

• Remove runtime checks based on pooling params (#24051)

  Show description for d59c986
  maxdebayser

  authored
  d59c986

  Copy full SHA for d59c986

Commits on Aug 29, 2025

• [V0 Deprecation] Remove pooling model support in V0 (#23434)

  Show description for 2554b27
  

  maxdebayser

  and

  WoosukKwon

  authored
  2554b27

  Copy full SHA for 2554b27

Commits on Aug 16, 2025

• Fix handling of `max_num_batched_tokens` for pooling tasks (#23004)

  Show description for 52ce142
  maxdebayser

  authored
  52ce142

  Copy full SHA for 52ce142

Commits on Aug 11, 2025

• Support token_type_ids in V1 with less code changes (#21985)

  Show description for 39052db
  maxdebayser

  authored
  39052db

  Copy full SHA for 39052db

Commits on Aug 7, 2025

• Support encoder_only attention for FlexAttention (#22273)

  Show description for f825c6b
  maxdebayser

  authored
  f825c6b

  Copy full SHA for f825c6b

Commits on Jul 26, 2025

• Support encoder-only models without KV-Cache (#21270)

  Show description for 1cd6eab
  

  maxdebayser

  and

  russellb

  authored
  1cd6eab

  Copy full SHA for 1cd6eab

Commits on Jul 16, 2025

• Avoid direct comparison of floating point numbers (#21002)

  Show description for 6ebf313
  maxdebayser

  authored
  6ebf313

  Copy full SHA for 6ebf313

Commits on Jul 12, 2025

• Remove extra tensor on CPU (#20693)

  Show description for 5de8d9f
  maxdebayser

  authored
  5de8d9f

  Copy full SHA for 5de8d9f

Commits on Jun 19, 2025

• Support embedding models in V1 (#16188)

  Show description for 799397e
  

  maxdebayser

  and

  22quinn

  authored
  799397e

  Copy full SHA for 799397e

Commits on May 29, 2025

• Prevent the cross-encoder logic from being applied to classification tasks (#18838)

  Show description for 515b413
  

  maxdebayser

  and

  DarkLight1337

  authored
  515b413

  Copy full SHA for 515b413

Commits on May 26, 2025

• [Bugfix] Fix the lm_head in gpt_bigcode in lora mode (#6357)

  Show description for 561b77a
  maxdebayser

  authored
  561b77a

  Copy full SHA for 561b77a

Commits on May 12, 2025

• Initialize the delta tool call fields explicitly (#17340)

  Show description for 05a4324
  

  maxdebayser

  and

  iGmainC

  authored
  05a4324

  Copy full SHA for 05a4324

Commits on Apr 24, 2025

• Add chat template for Llama 4 models (#16428)

  Show description for 05e1fbf
  maxdebayser

  authored
  05e1fbf

  Copy full SHA for 05e1fbf

Commits on Mar 25, 2025

• Add workaround for shared field_names in pydantic model class (#13925)

  Show description for e977c11
  maxdebayser

  authored
  e977c11

  Copy full SHA for e977c11

Commits on Feb 12, 2025

• Further reduce the HTTP calls to huggingface.co (#13107)

  maxdebayser

  authored
  7c4033a

  Copy full SHA for 7c4033a

Commits on Feb 7, 2025

• Prevent unecessary requests to huggingface hub (#12837)

  maxdebayser

  authored
  6e1fc61

  Copy full SHA for 6e1fc61

Commits on Jan 29, 2025

• Fix the pydantic logging validator (#12420)

  Show description for ef001d9
  maxdebayser

  authored
  ef001d9

  Copy full SHA for ef001d9

Commits on Jan 9, 2025

• treat do_lower_case in the same way as the sentence-transformers library (#11815)

  Show description for 1fe554b
  maxdebayser

  authored
  1fe554b

  Copy full SHA for 1fe554b

Commits on Dec 11, 2024

• Fix streaming for granite tool call when <|tool_call|> is present (#11069)

  Show description for e39400a
  maxdebayser

  authored
  e39400a

  Copy full SHA for e39400a

Commits on Dec 2, 2024

• Fill TorchSDPAAttentionMetadata seq_lens_field for prefill (#10799)

  Show description for e25810a
  maxdebayser

  authored
  e25810a

  Copy full SHA for e25810a

Commits on Nov 25, 2024

• Support Cross encoder models (#10400)

  Show description for 214efc2
  

  maxdebayser

  and

  flaviabeo

  authored
  214efc2

  Copy full SHA for 214efc2

Commits on Nov 20, 2024

• Change granite chat template to keep json list formatting for tool calls (#10452)

  Show description for a324d3a
  maxdebayser

  authored
  a324d3a

  Copy full SHA for a324d3a

Commits on Nov 14, 2024

• Support Roberta embedding models (#9387)

  Show description for 4a18fd1
  

  maxdebayser

  and

  flaviabeo

  authored
  4a18fd1

  Copy full SHA for 4a18fd1

Commits on Nov 7, 2024

• [Frontend] Tool calling parser for Granite 3.0 models (#9027)

  Show description for ae62fd1
  maxdebayser

  authored
  ae62fd1

  Copy full SHA for ae62fd1

Commits on Oct 12, 2024

• [BugFix] Fix tool call finish reason in streaming case (#9209)

  Show description for ec10cb8
  maxdebayser

  authored
  ec10cb8

  Copy full SHA for ec10cb8

Commits on Sep 27, 2024

• [Feature] Add support for Llama 3.1 and 3.2 tool use (#8343)

  Show description for 344cd2b
  maxdebayser

  authored
  344cd2b

  Copy full SHA for 344cd2b

Commits on Aug 23, 2024

• [BugFix] Fix server crash on empty prompt (#7746)

  Show description for e25fee5
  maxdebayser

  authored
  e25fee5

  Copy full SHA for e25fee5

Commits on Aug 7, 2024

• [BugFix] Fix frontend multiprocessing hang (#7217)

  Show description for fde47d3
  

  maxdebayser

  and

  robertgshaw2-redhat

  authored
  fde47d3

  Copy full SHA for fde47d3