Skip to content

Prefetch each key tile from its own KV cache offset in flash attention - #81

Open
Shreyas8612 wants to merge 1 commit into
mainfrom
fix/flashattn-kv-tile-addressing
Open

Shreyas8612 wants to merge 1 commit into
mainfrom
fix/flashattn-kv-tile-addressing

Prefetch each key tile from its own KV cache offset

c6735c4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
MoE stage-attribution guard
succeeded Sep 17, 2026 in 11s