AI agents increasingly rely on complex training pipelines. A team from TikTok parent Bytedance and several US universities aims to show that three steps are enough.
AI models are expected to research the web on their own, run code, and solve multi-step tasks. According to a new paper, the training methods behind these capabilities are growing more and more nested, with many developers stacking numerous training phases one after another. The paper argues it’s become almost impossible to tell which step actually helps, and reproducing the work is getting expensive.
