Why models believe in skepticism
Source: LessWrong ·
TL;DR: a lot of frontier open-weight models state during deployment in their CoTs that they are in a "simulation" or "fictional scenario" (although they never tell the user that). I present examples of this worrying tendency (which I believe includes the UK AISI Mythos incident) and hypothesize that this is due to RL promoting motivated reasoning (if the models believe they are in a fictional scenario they believe they have license to cheat and reward hack) and distributional shift from the pretraining environment to deployment. I also cover my hypothesis for why models become less skeptical a
Frequently Asked Questions
What is Why models believe in skepticism?
Why models believe in skepticism is a article discovery curated from LessWrong. TL;DR: a lot of frontier open-weight models state during deployment in their CoTs that they are in a "simulation" or "fictional scenario" (although they never tell the user…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →5 Actors Who Should Play M In Robert Pattinson's James Bond Movies
James Bond's boss M calls for an Oscar-caliber actor, so here are our picks for who should play the role opposite Robert Pattinson as 007.
Mariska Hargitay Made Her Acting Debut In A Cult Favorite '80s Horror Movie
Long before becoming synonymous with the Law & Order franchise, Mariska Hargitay got her film acting start in this Gremlins-y '80s horror movie.
5 Of The Best Sci-Fi Movie Black Friday Deals Under $20
You want some red hot Black Friday deals on sci-fi movies you can buy for under $20? Even if you don't, play along and click this link!
Guy Pearce's Remake Of A '60s Sci-Fi Classic Deserved Better At The Box Office
In 2002, Guy Pearce starred in an ill-fated movie adaptation of a classic sci-fi novel that had already been adapted into a film in the 1960s.
Why Beetee Latier From The Hunger Games: Sunrise On The Reaping Looks So Familiar
The Hunger Games: Sunrise on the Reaping stars Kelvin Harrison Jr. as the younger version of Beetee Latier. Here's where you might know Harrison from.
Before Spider-Man, Kirsten Dunst Was In An Episode Of Star Trek: The Next Generation
Before her big break with Interview with the Vampire, and long before Spider-Man, Kirsten Dunst showed up on Star Trek: The Next Generation.