Skip to content

[CUDA] Support batch_size >= 1 in SpeculativePrefixCommit - #33626

Merged
Tianlei Wu (tianleiwu) merged 2 commits into
asonawane/main-ops-mtp-fold-statefrom
tlwu/20261026/speculative-prefix-commit-batched
Oct 26, 2026
Merged

Tianlei Wu (tianleiwu) merged 2 commits into
asonawane/main-ops-mtp-fold-statefrom
tlwu/20261026/speculative-prefix-commit-batched

lintrunner

1dc5b37
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

5 warnings
Python format
succeeded Oct 26, 2026 in 1m 59s