Skip to content
onsuggest
Log in
Article en

Why models believe in skepticism

Source: LessWrong ·

TL;DR: a lot of frontier open-weight models state during deployment in their CoTs that they are in a "simulation" or "fictional scenario" (although they never tell the user that). I present examples of this worrying tendency (which I believe includes the UK AISI Mythos incident) and hypothesize that this is due to RL promoting motivated reasoning (if the models believe they are in a fictional scenario they believe they have license to cheat and reward hack) and distributional shift from the pretraining environment to deployment. I also cover my hypothesis for why models become less skeptical a

What is Why models believe in skepticism?

Why models believe in skepticism is a article discovery curated from LessWrong. TL;DR: a lot of frontier open-weight models state during deployment in their CoTs that they are in a "simulation" or "fictional scenario" (although they never tell the user…

How can I access or experience this?

You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.

Where does this content come from?

Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.

Keyboard shortcuts

Previous discovery
←P
Next discovery
→N
Like
L
Not for me
X
Save
S
Show this help
?
Close
Esc

Shortcuts work on the discovery page.