arXiv:2611.26531v1 Announce Type: cross
Abstract: Large Web platforms operate large fleets of ranking models, each selecting features from a shared pool of tens of thousands. We present an end-to-end agentic system that optimizes features across the fleet under resource constraints shared across models and those set per model, such as feature pipeline cost and serving throughput (QPS), respectively. In this system, LLM agents propose hypotheses, and deterministic tools execute experiments and verify them. For each model, an LLM generates and shortlists cross features from a combinatorial candidate space, and all features are then ranked by several importance methods. Feature blending mixes these rankings into a single selection, using Pareto fronts across tasks for multi-task models. An LLM Researcher agent then tunes the feature selection in 10–25 asynchronous trials under resource caps, and a trimming step keeps the pipeline cost within budget. Across production models, the system improves normalized entropy by 0.31% on average within each model’s budget, and the trimming step cuts pipeline cost by 2.3% with no regression beyond measurement noise. The optimized models were launched, and in online A/B tests they improved a primary online metric by 0.20%.
Trending
- Cost-Aware Agentic Feature Optimization System for Fleet-Scale Ranking Models
- TRCF: Temporal-Reference Complementary Forecasting for Irregular Multivariate Time Series
- [2611.26515] Simple Private Noisy SGD is Minimax-Optimal under Population Strong Convexity
- OceanCoder: A Verification-Guided Large Language Model for Automated Simulation Modelling in Ocean Engineering
- Bayesian optimization on amortized search space
- [2611.26323] Predicting Surface Displacement Fields of Laser Powder Bed Fusion Parts Using STL-Derived Graphs and Part-Level Descriptors
- Should Belgians Install an Advanced Energy Management System in Their Electrified Dwelling ?
- A Control-Theoretic Approximation to Predictive Coding Dynamics
