中文UniEmo:利用可学习的专家查询统一情感理解与生成
ENUniEmo: Unifying Emotional Understanding and Generation with Learnable Expert Queries
本文提出UniEmo统一框架,将情感理解与生成两大互补任务无缝整合。关键挑战在于情感的抽象性,需提取对两任务均有益的视觉表示。方法亮点:采用分层情感理解链(hierarchical emotional understanding chain)及可学习专家查询(learnable expert queries),逐步提取多尺度情感特征。实际意义:该框架可有效促进情感AI系统理解与生成能力的协同提升,为情感计算应用提供统一解决方案。
arXiv:2507.23372v2 Announce Type: replace Abstract: Emotional understanding and generation are often treated as separate tasks, yet they are inherently complementary and can mutually enhance each other. In this paper, we propose the UniEmo, a unified framework that seamlessly integrates these two tasks. The key challenge lies in the abstract nature of emotions, necessitating the extraction of visual representations beneficial for both tasks. To address this, we propose a hierarchical emotional understanding chain with learnable expert queries that progressively extracts multi-scale emotional f