Close Menu
techwavedispatch.com

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    We haven’t seen the last of the major tech outages

    November 22, 2026

    Can You Safely Use A 140w Charger On An iPhone?

    November 22, 2026

    This Free App Connects Your Android Phone To Your Windows PC Wirelessly

    November 22, 2026
    Facebook X (Twitter) Instagram
    Trending
    • We haven’t seen the last of the major tech outages
    • Can You Safely Use A 140w Charger On An iPhone?
    • This Free App Connects Your Android Phone To Your Windows PC Wirelessly
    • How To Safely Clean Your PC’s GPU To Avoid Damaging It In The Process
    • Why Your Monitor Flickers When You Turn It On And Can It Be Fixed?
    • The Cool Phone Camera Trick That Can Test Your Remote Control’s Battery
    • Which Solar Panel Type Is Best For Your Home?
    • OpenAI’s chief scientist has thoughts on how to limit AI development
    Facebook X (Twitter) Instagram
    techwavedispatch.com
    Subscribe
    Sunday, November 22
    • Home
    • AI Tools & Software
    • Machine Learning
    • Generative AI
    • Robotics & Automation
    • Future Tech & Hardware
    • AI in Business
    • Ethics & Regulations
    • More
      • Gadgets & Smart Devices
      • Cybersecurity & AI
      • Tech Breakthroughs
    techwavedispatch.com
    Home»Machine Learning»Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy
    Machine Learning

    Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy

    adminBy adminNovember 21, 2026No Comments2 Mins Read
    Facebook Twitter Pinterest LinkedIn Tumblr Email
    Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy
    Share
    Facebook Twitter LinkedIn Pinterest Email

    [Submitted on 19 Nov 2026]

    View a PDF of the paper titled Budget Internalization: Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy, by Ilia Zavidnyi and 4 other authors

    View PDF
    HTML (experimental)

    Abstract:Reasoning models often become more accurate when they can generate longer answers at test time. This behavior is known as test-time scaling. However, RL with verifiable rewards (RLVR) usually trains them with a fixed rollout cap. We find that this cap changes model behavior, not only training cost. After training, models use few additional tokens beyond the training budget. They outperform the base models near that budget, but their accuracy stops improving and falls below the base model at larger budgets. The rollout cap thus becomes a learned constraint, that limits model’s test-time scaling. We call this effect budget internalization. We observe it across Qwen3.5-4B, Gemma4-E2B, and Nemotron-3-Nano-4B and two reasoning training tasks: mathematical reasoning and diverse, procedurally generated problems. This effect also transfers from math training to science and coding tasks. Training-objective level ablations on Qwen3.5-4B show that most changes recover little test-time scaling. Stronger KL regularization and lower training-data truncation preserve more scaling, but stronger KL reduces in-budget accuracy. Forcing an answer on truncated training rollouts largely removes budget internalization, but also removes most of the in-budget gain. SFT on artificially truncated traces reproduces budget internalization, whereas SFT on naturally short traces does not, which shows that the effect is not specific to RL. This result links budget internalization to length-censored post-training rather than to an RL-specific objective term. Thus, a rollout cap does not only control training cost. It can trade low-budget gains for lower performance when additional inference compute is available.

    Submission history

    From: Alexander Kovrigin [view email]
    [v1]
    Thu, 19 Nov 2026 14:20:41 UTC (1,012 KB)

    accuracy FixedBudget InBudget RLVR scaling TestTime Trades
    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    admin
    • Website

    Related Posts

    HiSA: Sparsifying the Hidden Dimension of RoPE Attention in LLMs

    November 22, 2026

    Realized versus Population Reliability: Anytime-Valid Self-Consistency Certification under Correlated Reasoning

    November 22, 2026

    Learning from Context: Leave-One-Out Prediction in Jump Diffusions

    November 22, 2026
    Leave A Reply Cancel Reply

    Top Posts

    NVIDIA Is Investigating Reports That CEO Jensen Huang Was The Target Of Chinese Spy Efforts

    November 8, 202619 Views

    ADIndex: Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation

    November 11, 20266 Views

    Anthropic releases new Mythos and Fable models amid RSI concerns

    November 9, 20266 Views

    If AGI is so close, why is everyone leaving? The neolabs and their bets

    November 6, 20266 Views
    Don't Miss
    Cybersecurity & AI

    We haven’t seen the last of the major tech outages

    By adminNovember 22, 20260

    Over the last week or so, we have seen a nationwide FAA ground stop, a…

    Can You Safely Use A 140w Charger On An iPhone?

    November 22, 2026

    This Free App Connects Your Android Phone To Your Windows PC Wirelessly

    November 22, 2026

    How To Safely Clean Your PC’s GPU To Avoid Damaging It In The Process

    November 22, 2026
    About Us

    Welcome to TechWave Dispatch

    At TechWave Dispatch, we bring you the latest news, insights, and developments from the ever-evolving world of technology. Our mission is to keep readers informed about the innovations shaping our digital future.

    From artificial intelligence and machine learning to cybersecurity, robotics, smart devices, and groundbreaking technologies, we cover the topics that matter in today's fast-moving tech landscape.

    Our Picks

    We haven’t seen the last of the major tech outages

    November 22, 2026

    Can You Safely Use A 140w Charger On An iPhone?

    November 22, 2026

    This Free App Connects Your Android Phone To Your Windows PC Wirelessly

    November 22, 2026
    Most Popular

    Egyptian and Nigerian English join the Open ASR Leaderboard

    November 6, 20260 Views

    Ads in Chatbots Have Arrived. Here’s What’s Working—and What’s Not

    November 6, 20260 Views

    The General Purpose Pendulum – O’Reilly

    November 6, 20260 Views
    Facebook X (Twitter) Instagram Pinterest
    • Terms and Conditions
    • Privacy Policy
    • Contact Us
    • About Us
    © 2026 TechWave Dispatch. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.