中文NP-LoRA:基于零空间投影的主题风格LoRA融合
ENNP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
现有LoRA融合通过权重合并实现风格与内容组合,但忽略了共享子空间中的参数冲突。本研究从几何视角揭示:独立训练的LoRA占据重叠、非正交的低秩子空间,导致更新冲突。该发现为优化融合策略、提升生成一致性提供了理论依据。
arXiv:2511.11051v3 Announce Type: replace Abstract: Low-Rank Adaptation (LoRA) fusion enables the composition of subject and style representations for controllable generation without retraining. However, existing approaches primarily operate through weight-level merging, without explicitly modeling how independently trained LoRAs interact in the shared parameter space. We adopt a geometric perspective on LoRA fusion, interpreting content and style LoRAs as occupying overlapping, non-orthogonal low-rank subspaces, where such overlap can lead to conflicting parameter updates that affect generati