Skip to content

feat: support Qwen4-Exp expert defusion - #64

Merged
Qubitium merged 1 commit into
mainfrom
zx/qwen4-exp-support
Aug 31, 2026
Merged

feat: support Qwen4-Exp expert defusion#64
Qubitium merged 1 commit into
mainfrom
zx/qwen4-exp-support

Conversation

@ZX-ModelCloud

@ZX-ModelCloud ZX-ModelCloud commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • register qwen4_exp and qwen4_exp_text for mixed routed/shared expert defusion
  • verify defusion preserves Qwen4-Exp forward outputs and works with meta-initialized models
  • document support and bump the package version to 0.0.26

Tests

  • ruff check on the changed Python files
  • Qwen4-Exp focused pytest coverage: 3 passed

@Qubitium
Qubitium merged commit eabdfb6 into main Aug 31, 2026
28 checks passed
@Qubitium
Qubitium deleted the zx/qwen4-exp-support branch August 31, 2026 06:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants