Baiting monitorable reward hacks
来源: LessWrong ·
This is joint work between Ziqian Zhong, Lawrence Feng, Gaurav Rohit Ghosal, Jiangqi Dai, and Aditi Raghunathan. This work is supported by a BlueDot Rapid Grant. We are unsure of whether this intervention is net positive (see discussions below) despite positive results, but we think similar techniques are worth further studying. Gradient routing can fail to mitigate reward hacks when the models settle on hacks not caught by the monitor. For example, if we swap the monitorable and unmonitorable set of hacks in the Countdown-Code environment, GRAFT still settles on the now-unmonitorable hacks in
常见问题
什么是 Baiting monitorable reward hacks?
Baiting monitorable reward hacks is a 文章 discovery curated from LessWrong. This is joint work between Ziqian Zhong, Lawrence Feng, Gaurav Rohit Ghosal, Jiangqi Dai, and Aditi Raghunathan. This work is supported by a BlueDot Rapid Grant. We are unsure of…
如何访问或体验此内容?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
此内容来源于哪里?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
相关发现
所有 文化与思想 发现 →GTA 6 Already Got One Thing Very Wrong
Grand Theft Auto 6 is finally out, and despite all the attention Rockstar has given to details, it still manages to get one thing very wrong.
Mckenna Grace's New Netflix Series Is A Role She Was Born To Play
Mckenna Grace may be making headlines for her performance in the new Hunger Games movie, but her role in Scooby-Doo: Origins could be even better.
Box Office: Hunger Games Is The Victor, Stallone’s Rocky Biopic Scores Underdog #2
The Hunger Games: Sunrise on the Reaping debuts at No. 1 at the domestic box office with a record-breaking opening while I Play Rocky Lands at No. 2.
Mckenna Grace’s New Sci-Fi Movie Is One Of 2026's Biggest Hits After Just 3 Days
The new sci-fi movie starring Mckenna Grace has a solid global box office debut that makes it one of 2026's biggest movies in just three days.
GTA 6: Should You Give Halifax The Statue In "Dubious Provenance"
Halifax is certainly one of the more eccentric characters in GTA 6, and he's going to ask you to hand over the bronze statue in Chapter 3.
GTA 6 Is The Bonnie And Clyde Remake Hollywood Never Made
After a long wait, Grand Theft Auto 6 is finally here, and the story is reminiscent of the classic Bonnie and Clyde tale.