Eval Awareness as Eval-type Awareness
Source: LessWrong ·
The way eval awareness is discussed in the AI safety discourse, either here or on X, can be misleading. Before today, I think I had the wrong mental model of why eval awareness was a problem, and I am writing here in case anyone was making the same errors in their thinking, as well a present a working theory. As laid out in " A Framework for Eval Awareness " the problem is that models who know they are being evaluated will behave differently than they would in deployment. This raises a huge problem if we want calibrations as to, for example, how honest a model is. But the way this is then spok
Frequently Asked Questions
What is Eval Awareness as Eval-type Awareness?
Eval Awareness as Eval-type Awareness is a article discovery curated from LessWrong. The way eval awareness is discussed in the AI safety discourse, either here or on X, can be misleading. Before today, I think I had the wrong mental model of why eval awareness…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →The Brilliant Find That Convinced Me to Quit Plastic Storage Containers Forever Is 50% Off
Plus, 5 more early Black Friday deals too good to miss. READ MORE...
Potatoes Savoyard
It’s just as delicious as regular scalloped potatoes. READ MORE...
See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream]
The day’s finally arrived for horror gamers, as the 2026 edition of The Horror Game Awards airs today at 2PM EST / 7PM GMT from 26 Leake Street in London, England. If you missed last month’s reveal of the nominees, Tarsier Studios’ REANIMAL leads the pack with 10 nominations, which includes Game of the Year. […] The post See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream] appeared first on Bloody Disgusting! .
Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer]
Add another game inspired by H.P. Lovecraft to your list, as developer Darktree Game Studio and Ultimate Games S.A. have announced a January 14 release date on Steam for their upcoming first-person survival horror title, Remnants of R’lyeh. You can also check out the demo now on Steam. The year is 1926, and deep sea […] The post Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer] appeared first on Bloody Disgusting! .
‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror
As more and more mainstream, big budget horror games seem to shift towards an action-focused mindset, we’ve seen the indie space pick up the mantle of classic survival horror. While many of them draw their inspiration from titans of the genre like Silent Hill or Resident Evil, we rarely see games that try to mimic […] The post ‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror appeared first on Bloody Disgusting! .