[Akshay Sonawane (apsonawane)]

Main integration update

Merged repository main at 9a662b9395c7c5dc619ae4d050f2c9362d88eae3. Published head: e15aebba7f976b58f4826a06461ad0f6d103c5c8. Existing PR bases remain unchanged.

• The exact remote head contains main and all preceding updated stack layers.
• Used the qwen-flash conda environment; ran lintrunner -a before each new commit, followed by clean lint checks. Final branch-vs-main lint passes.
• Published with normal fast-forward pushes, without amendments or force pushes.
• No new benchmark/profiling/evaluation scripts or co-author trailers.
• Validation includes C++ schema syntax checks, targeted CUDA SM90/host compilation of the affected operator families, and compilation of sparse/GDN/QMoE regression tests.
• Preserved main's updated decode/API/IndexShare interfaces while adapting the local specializations; fixed merge-created declaration/template/adapter overlaps.
• No complete rebuild or GPU/model requalification has run on this integrated snapshot. Earlier benchmark/parity results below apply to the pre-main combined snapshot, not this merge. The earlier GDN state-output failure remains unresolved.

This update supersedes earlier notes saying main has not been integrated, but does not remove the draft/build/runtime qualification requirements.

Summary

Update contrib operator/kernel documentation for the stack and include the remaining compatibility/formatting adjustments.

Stack and main target

Depends on #33464.

This is layer 7/7 of the microsoft/onnxruntime stack. The current review base is asonawane/ported-ops-mtp-fold-state so this PR shows only its incremental group. The final destination is upstream main: land/reconcile prerequisites first, then rebase and retarget this layer to main. Keep this PR in draft until that base-specific validation succeeds. Do not merge the entire stack through an unvalidated intermediate base.

Cross-repository dependency: GenAI package/runtime integration requires the companion ORT contrib operators.

Validation and blockers

• Combined qualified source snapshot: 286/287 selected operator tests pass.
• Known blocker: GatedDeltaNetTest.RecurrentOutputsIncludeFirstRowState fails in the existing combined workspace.
• Three previously documented packed-indexer baseline failures were excluded: RejectsWrongOutputCount, QsaMalformedStateLengthsAreClamped, CsaMalformedStateLengthsAreClamped.
• Five MTP/fold kernel tests pass separately.
• Split schema translation units pass syntax checks at their individual stack stages.
• Combined tip is byte-identical to the original workspace snapshot. Individual branch builds and upstream-main CI are still required.

Scope

• Preserve the original dirty worktrees and existing PR branches.
• No benchmark runners, profiling utilities, evaluation drivers, model weights or local task metadata in the new commits.
• No Copilot co-author trailers in the new commit messages.
• Broad compatibility with other models is not established by local Qwen qualification.

Stack navigation

• Add exact normalization and rotary CUDA operator modes
• Add fused hyper-connection and tensor CUDA operators
• Extend GDN and causal convolution fused state handling
• Extend sparse attention caches and optimize packed indexing
• Optimize quantized MoE and block-scaled FP8 CUDA projections
• Add fused MTP MoE and speculative state fold CUDA operators
• Document generic CUDA operators and complete build compatibility

Companion repository stack:

• Add Qwen CUDA graph execution through Generator
• Add generic operator package rewrites and integration tests

[Akshay Sonawane (apsonawane)]

Closing this draft to replace the feature-based stack with focused branches rebuilt from current main. Existing branches are preserved; replacement PRs will be linked here.

[Akshay Sonawane (apsonawane)]

Documentation is now bundled with the independent main-based operator replacements: #33469, #33470, #33471, #33472, #33473, #33474. No separate documentation stack is needed; the obsolete adapter-accessor removal was not carried forward because current main already has exactly one valid accessor.