Issues

• feat(vllm): serve audio transcription through the vLLM sidecar

  backend::vllmenhancementFeaturelanguage::rustmultimodal
  ai-dynamo/dynamo#17738 · Filter by author NurullahMorshed opened on Oct 30, 2026

• [BUG]: v2 route dispatches a wrapped <tool_call> quoted inside the thought as a second tool call (residual of #17663)

  bugfrontendsig-frontendtool-calling
  ai-dynamo/dynamo#17732 · Filter by author luckyq opened on Oct 30, 2026
  

• TensorRT-LLM sidecar: engine-loss handling without KV events

  backend::trtllmenhancementlanguage::rust
  ai-dynamo/dynamo#17721 · Filter by author JulienDarve opened on Oct 30, 2026
  

• SGLang sidecar: engine-loss handling without KV events

  backend::sglangenhancementlanguage::rust
  ai-dynamo/dynamo#17720 · Filter by author JulienDarve opened on Oct 30, 2026
  

• DEP: Prefill request cancellation in disaggregated serving

  backend::sglangbackend::trtllmbackend::vllmdep:draftdynamo-runtimelanguage::rustrouterruntimesig-router
  ai-dynamo/dynamo#17718 · Filter by author tanmayv25 opened on Oct 30, 2026
  

• [BUG]: usage.completion_tokens_details is missing when a request turns thinking off

  bugdynamo-llmlanguage::rust
  ai-dynamo/dynamo#17705 · Filter by author sumant-TT opened on Oct 30, 2026
  

• [FEATURE]: Let library users of Dynamo's crates take newer tokio and axum (relax the = pins)

  dependenciesenhancementlanguage::rust
  ai-dynamo/dynamo#17697 · Filter by author ryanolson opened on Oct 30, 2026
  

• perf(vllm): token requests take vLLM's renderer thread-pool round trip

  backend::vllmlanguage::pythonperformance
  ai-dynamo/dynamo#17689 · Filter by author cbg opened on Oct 30, 2026

• [FEATURE]: Add pluggable persistent session affinity to the Global Router

  enhancementroutersig-router
  ai-dynamo/dynamo#17674 · Filter by author sachalmalick opened on Oct 30, 2026

• SGLang sidecar: publish observed weight versions as optional routing taints

  backend::sglangdeployment::k8sdynamo-deployenhancementlanguage::rustrouter
  ai-dynamo/dynamo#17671 · Filter by author AndyDai-nv opened on Oct 30, 2026

• [BUG]: DYN_PARSER_VERSION=2 + qwen3_coder: thinking runs to max_tokens and the v2 scanner returns 19 duplicate tool calls recovered from reasoning

  bugfrontendsig-frontendtool-calling
  ai-dynamo/dynamo#17663 · Filter by author luckyq opened on Oct 30, 2026
  

• [BUG]: qwen3_coder parser emits JSON strings for arguments declared via $ref, allOf, type arrays, not, or if/then/else

  bugfrontendlanguage::rustsig-frontendtool-calling
  ai-dynamo/dynamo#17662 · Filter by author luckyq opened on Oct 30, 2026
  

• [BUG]: strict tool with JSON-pointer-escaped $ref (~0 ~1 %20) fails structural-tag compile and returns an opaque 400

  bugdynamo-llmfrontendlanguage::rusttool-calling
  ai-dynamo/dynamo#17661 · Filter by author luckyq opened on Oct 30, 2026
  

• [CONTRIBUTION]: EPP bounded graceful draining of owned connections

  epplanguage::rust
  ai-dynamo/dynamo#17658 · Filter by author theo-ai-lab opened on Oct 30, 2026

• SGLang chat processor needs compatibility with recipe-based DeepSeek encoding

  backend::sglangbugfrontendlanguage::pythonsig-frontend
  ai-dynamo/dynamo#17654 · Filter by author xianlubird opened on Oct 30, 2026
  1

  

• DEP: Cross-backend decision execution and qualification for SGLang and vLLM 0.32

  backend::sglangbackend::vllmdep:draftfrontendrouterruntime
  ai-dynamo/dynamo#17649 · Filter by author biswapanda opened on Oct 30, 2026

• DEP: vLLM sidecar engine-loss handling without KV events

  backend::sglangbackend::trtllmbackend::vllmdep:draftdynamo-runtimeenhancementlanguage::rustruntime
  ai-dynamo/dynamo#17643 · Filter by author JulienDarve opened on Oct 30, 2026
  

• [Feature]: Add a Harbor, Agent Substrate, and Dynamo coding-agent example

  agentscideployment::k8sfrontend
  ai-dynamo/dynamo#17642 · Filter by author tmonty12 opened on Oct 30, 2026

• Session affinity: hard pin should be DP-rank-level for every routing policy (vLLM pins only worker_id on non-KV policies)

  dynamo-llmlanguage::rustroutersig-router
  ai-dynamo/dynamo#17641 · Filter by author alec-flowers opened on Oct 30, 2026
  1

• DEP: Global Router replica sync — shared bookings and session pins between Global Frontends

  dep:draftenhancementroutersig-router
  ai-dynamo/dynamo#17639 · Filter by author nnshah1 opened on Oct 30, 2026

• DEP: Global Router selects pools through the embedded router core

  dep:draftenhancementroutersig-router
  ai-dynamo/dynamo#17638 · Filter by author nnshah1 opened on Oct 30, 2026

• Tool calls are blocked when a request combines tool_choice="auto" with response_format

  dynamo-llmfrontendlanguage::rusttool-calling
  ai-dynamo/dynamo#17619 · Filter by author indrajit96 opened on Oct 29, 2026
  

• [BUG]: Beam EOS and mandatory tool constraints fixes are missing from main

  bugfrontendlanguage::rusttool-calling
  ai-dynamo/dynamo#17618 · Filter by author neilkg opened on Oct 29, 2026
  1

  

• [CONTRIBUTION]: vLLM: opt-in decode regulation for interactive deadlines under agent load

  agentsbackend::vllmenhancementperformancepythonsig-agents
  ai-dynamo/dynamo#17613 · Filter by author anjalibshah opened on Oct 29, 2026

• DEP: Per-role router policies with no global policy settings

  dep:draftdynamo-llmdynamo-runtimeenhancementlanguage::rustroutersig-router
  ai-dynamo/dynamo#17607 · Filter by author alec-flowers opened on Oct 29, 2026
  2