Comment on: 模型参数合并问题 + I2V训练优化 + 如何蒸馏Helios-Base
Repo: PKU-YuanGroup/Helios by SHYuanBest
基于Helios-base模型训完了stage-1-post指的是跑完了以下三个步骤?
1. 加载wan_transformer,用stage-1-inint去训,得到A lora_ckpt + A partial_ckpt
2. merge wan_transformer + A lora_ckpt + A partial_ckpt得到B_transformer
3. 得到B_transformer,用stage-1-post去训,得到B lora_ckpt + B partial_ckpt
4. 此时merge的时候应该加载B_transformer
GitHub Issue
SaaS Metrics