test(qwen3.5): preserve MoE expert stack ordering#653
Conversation
|
|
# Conflicts: # src/models/qwen3_5.rs
|
Thanks for the contribution and for tracking down the Qwen3.5 MoE switch projection naming mismatch. I audited the PR against current The main loader/sanitizer implementation is now already equivalent on I will push a small follow-up commit to this PR that drops the now-redundant implementation delta and keeps only a cleaned-up, focused test. After that I will rerun the relevant qwen3_5 sanitizer regression and merge if the branch remains clean. |
Summary
src/models/qwen3_5_tests.rsgate_proj,up_proj, anddown_projtensors are stacked into the currentswitch_mlp.*_projloader names while preserving expert order and projection valuesAudit result
The original implementation delta is already present on current
mainvia #671, which closed #670. This branch now leaves the mainqwen3_5::sanitize_weightsimplementation unchanged and only contributes additional regression coverage aligned with the currentSwitchGLU/SparseMoeBlocknaming convention.Validation
cargo fmt --all -- --checkcargo test qwen3_5::sanitize_tests -- --nocaptureRefs #670 and #671