GO4Align: Group Optimization for Multi-Task Alignment
CoRR(2024)
Abstract
This paper proposes GO4Align, a multi-task optimization approach
that tackles task imbalance by explicitly aligning the optimization across
tasks. To achieve this, we design an adaptive group risk minimization strategy,
compromising two crucial techniques in implementation: (i) dynamical group
assignment, which clusters similar tasks based on task interactions; (ii)
risk-guided group indicators, which exploit consistent task correlations with
risk information from previous iterations. Comprehensive experimental results
on diverse typical benchmarks demonstrate our method's performance superiority
with even lower computational costs.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined