Skip to content

[CUDA] Enable tanh-GEGLU for MoE and integer QMoE - #33633

Open
Ti-Tai Wang (titaiwangms) wants to merge 3 commits into
mainfrom
titaiwang/gemma4-geglu-cuda
Open

[CUDA] Enable tanh-GEGLU for MoE and integer QMoE#33633
Ti-Tai Wang (titaiwangms) wants to merge 3 commits into
mainfrom
titaiwang/gemma4-geglu-cuda

test: cover biased GEGLU and mixed-width QMoE

9274182
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar