arXiv:2611.25430v1 Announce Type: new
Abstract: Combining fine-tuned models by composing their parameter updates has become a standard alternative to multi-task training. We formalize composability as a property of a collection of task vectors and prove that the excess loss of the merged model is controlled by an interference functional of the cross-task curvature overlap and the signed alignment of the updates. In the quadratic regime this functional equals the excess loss, giving a criterion that is necessary as well as sufficient and that measures the angle between task vectors in the curvature metric rather than the Euclidean one. Fine-tuning under a curvature-guided regularizer — constructed from curvature statistics of the kind memory-efficient optimizers maintain — keeps displacement in the base curvature metric below a ceiling set by the penalty coefficient at every iterate, at the standard $O(1/\sqrt{T})$ non-convex rate. Under a single Loewner comparison between the base statistic and the task curvatures, this control converts into a ceiling on the interference functional, inversely proportional to the penalty coefficient, so that the curvature term of the bound is controlled during training. A first-order term, present because regularized solutions are not stationary for the task loss, is not reduced in the same way. Experiments on an exact non-quadratic model confirm the budget and the ceiling, show the first-order term dominating for strong penalties, and find the curvature-guided penalty slightly better than an isotropic one. In a three-seed transformer study the functional is rank-correlated with merging degradation, but no more strongly than the Euclidean displacement norm.
Trending
- How Google Duplex evolved to also call businesses for you in Gemini
- Interference Bounds and Merge-Aware Training Dynamics for Composable Fine-Tuned Models
- Introducing managed cluster extensions for observability and user management in Amazon SageMaker HyperPod Slurm
- An Open Dataset of AI-powered H&E Tumor Microenvironment Profiles from TCGA
- Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters
- FCC orders California to stop enforcing phone service rules against AT&T
- The Internet Archive’s Workers Are Unionizing
- [2611.25424] Coordinate Basis Linear Bandits with Sublinear Regret over Low-Rank Clusters
