Skip to content

[megatron][vlm] Allow sequence packing for VLMs incl. Qwen3.5-VL (CP=1) - #2357

Open
xinyuangui2 wants to merge 10 commits into
NovaSky-AI:mainfrom
xinyuangui2:vlm-megatron-packing
Open

xinyuangui2 wants to merge 10 commits into
NovaSky-AI:mainfrom
xinyuangui2:vlm-megatron-packing

[train] Note that VLM SFT stays unpacked; packing is enabled for RL

b26cf01
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
test
succeeded Oct 6, 2026 in 1m 50s