Skip to content

[CUDA] Optimize HyperConnectionLowRankMix for S<=8 speculative decode and deterministic prefill - #33548

Open
Akshay Sonawane (apsonawane) wants to merge 15 commits into
mainfrom
asonawane/dflash2-s4-hyperconnection
Open

[CUDA] Optimize HyperConnectionLowRankMix for S<=8 speculative decode and deterministic prefill#33548
Akshay Sonawane (apsonawane) wants to merge 15 commits into
mainfrom
asonawane/dflash2-s4-hyperconnection

[CUDA] HyperConnectionLowRankMix: remove ORT_HC_S8_DECODE_ROWS, alway…

4530b1f
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar