arXiv:2611.26096v1 Announce Type: cross
Abstract: Personalized content recommendation on large marketplace websites must reconcile heterogeneous candidate content (e.g., customer stories, product pages, industry pages, and learning content) with sparse, fast-changing user behavior, placing increasing demands on the retrieval stage to represent user interest well, not just the downstream ranking stage. We present LSER (LLM Session Embedding Retrieval), a production content recommendation system for autodesk.com that derives session- and history-level embeddings from a pretrained large language model (LLM) and adds them as auxiliary user-side features in the retrieval-stage user tower alongside existing learned sequence encoders. To keep user-side embeddings fresh under real-time behavior, we build a nearline serving path that asynchronously refreshes sequential and LLM-derived user vectors for our main content recommendation server. We validate the incremental value of the LLM features through an ablation study across our full multi-content-type catalog. Our results indicate that integrating LLM-derived embeddings as additional retrieval signals, together with production-grade nearline serving, is technically feasible and can improve model performances.
Trending
- Why Does Your Phone Say No Service Even With A SIM Card?
- From Sessions to Serving: Integrating LLM-Based Embeddings into Retrieval for Production Content Recommendation
- The Free Raspberry Pi Tool You Should Be Using To Access It Remotely
- Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy
- Review: Godzilla Minus Zero is everything we could want in a sequel
- Amazon is complaining about NYC Council on shipping labels, too
- This Built-In Windows Tool Can Tell If Your DirectX Has A Problem
- Understanding MoE Decisions Beyond Gradients
