2024年12月24日 星期二 新京报
Copyright © 1997-2026 by www.people.com.cn all rights reserved
。谷歌浏览器【最新下载地址】对此有专业解读
An important direction for future research is understanding why default language models exhibit this confirmatory sampling behavior. Several mechanisms may contribute. First, instruction-following: when users state hypotheses in an interactive task, models may interpret requests for help as requests for verification, favoring supporting examples. Second, RLHF training: models learn that agreeing with users yields higher ratings, creating systematic bias toward confirmation [sharma_towards_2025]. Third, coherence pressure: language models trained to generate probable continuations may favor examples that maintain narrative consistency with the user’s stated belief. Fourth, recent work suggests that user opinions may trigger structural changes in how models process information, where stated beliefs override learned knowledge in deeper network layers [wang_when_2025]. These mechanisms may operate simultaneously, and distinguishing between them would help inform interventions to reduce sycophancy without sacrificing helpfulness.
Q&A (Bill Williams)