Repository navigation

[CUDA] Enable tanh-GEGLU for MoE and integer QMoE - #33633

Open

Ti-Tai Wang (titaiwangms) wants to merge 3 commits into

mainfrom

titaiwang/gemma4-geglu-cuda

Open

[CUDA] Enable tanh-GEGLU for MoE and integer QMoE#33633
Ti-Tai Wang (titaiwangms) wants to merge 3 commits into
mainfrom
titaiwang/gemma4-geglu-cuda

Commits on Oct 27, 2026
- Enable tanh-GEGLU in CUDA MoE and integer QMoE
  
  Copilot
  and
  Copilot
  committed
  660f358
- Update generated MoE and QMoE GEGLU documentation
  Copilot
  committed
  e93f309
- test: cover biased GEGLU and mixed-width QMoE
  
  Copilot
  and
  Copilot
  committed
  9274182