Probe monitors seem to perform realistically in simulated control environments
Source: LessWrong ·
TL;DR In simulated control evaluations , instead of executing an agent’s proposed commands and returning the outputs, a language model simulates what the outputs would have been. This allows control evals to be more on-distribution for deployment use without actually running on production systems. However, imperfect simulators may create a subtle distribution shift that changes the behavior of white-box methods such as probes. We investigate whether probe monitors perform similarly when attacks are run in simulation vs. when they are run for real. We run attacks with Qwen3.5-27B against 1,313
Frequently Asked Questions
What is Probe monitors seem to perform realistically in simulated control environments?
Probe monitors seem to perform realistically in simulated control environments is a article discovery curated from LessWrong. TL;DR In simulated control evaluations , instead of executing an agent’s proposed commands and returning the outputs, a language model simulates what the outputs would have been…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →The Brilliant Find That Convinced Me to Quit Plastic Storage Containers Forever Is 50% Off
Plus, 5 more early Black Friday deals too good to miss. READ MORE...
Potatoes Savoyard
It’s just as delicious as regular scalloped potatoes. READ MORE...
See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream]
The day’s finally arrived for horror gamers, as the 2026 edition of The Horror Game Awards airs today at 2PM EST / 7PM GMT from 26 Leake Street in London, England. If you missed last month’s reveal of the nominees, Tarsier Studios’ REANIMAL leads the pack with 10 nominations, which includes Game of the Year. […] The post See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream] appeared first on Bloody Disgusting! .
Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer]
Add another game inspired by H.P. Lovecraft to your list, as developer Darktree Game Studio and Ultimate Games S.A. have announced a January 14 release date on Steam for their upcoming first-person survival horror title, Remnants of R’lyeh. You can also check out the demo now on Steam. The year is 1926, and deep sea […] The post Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer] appeared first on Bloody Disgusting! .
‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror
As more and more mainstream, big budget horror games seem to shift towards an action-focused mindset, we’ve seen the indie space pick up the mantle of classic survival horror. While many of them draw their inspiration from titans of the genre like Silent Hill or Resident Evil, we rarely see games that try to mimic […] The post ‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror appeared first on Bloody Disgusting! .