arXiv:2611.21701v1 Announce Type: new
Abstract: Learning-rate choices strongly affect language-model fine-tuning, but the best joint profile across layer groups is generally unknown. This paper studies quantum minimum finding for layer-group learning-rate selection within a hybrid classical-quantum training framework. It combines Durr-Hoyer minimum finding with BBHT search and compares fixed-budget and confidence-based stopping policies using a lookup oracle built from measured profile scores at fixed training checkpoints. The paper then introduces an Interaction-Guided Schedule Oracle that scores and marks joint schedules in superposition without a precomputed score table. Classical one-step loss measurements supply the main, pairwise and three-way interaction effects between layer groups. The circuit adds the effects for each schedule, compares the resulting score with the current baseline score, and marks improving schedules for amplitude amplification. Measured candidates are checked classically before acceptance. Uniform-rate training supplies the initial baseline; using schedules from classical adaptive methods as baselines for joint refinement is left for future work. In closed-loop fine-tuning of a 1.5-billion-parameter language model, each selected schedule drives the next 200 classical training steps. Benchmark accuracies lie within the range observed across five uniform-rate seeds. The results give a working example of how quantum superposition can support adaptive learning-rate selection during training; the remaining quantum limitations are discussed in the paper.
Trending
- Hours after Anthropic claims a Claude proof of the Riemann hypothesis, Stanford releases an all-human competing draft
- [2609.37351] Clause-Factored Bilateral State Grounding and Scoped Passivity for Counterfactual Open-World Deductive Reasoning
- Best Laptops for Travel (2026): Which to Take on the Road
- [2611.25796] How Reliable Are Explanations of Language Models That Detect Insider Threats?
- Lifting Classifier Training with Latent Gaussian Mixture Models
- New open model Inkling 2 Mini thinks in loops to solve problems with fewer words and still runs on a laptop
- RouteVerify: Routing Interventions for Step-Level Verification in Mixture-of-Experts Models
- US technology stocks suffer their worst weekly loss since the pandemic as AI doubts pile up
