Gradient Routing Creates a Headstart
Source: LessWrong ·
Tl;dr GRAFT showed that we can make reward hacking removable. In the setup we study, a small LLM has two trainable adapters, each consisting of an additional MLP in every layer. Training updates from detected hacks are routed only into one, called FORGET, which is removed ('forgotten') after training to suppress the behaviour. We reproduced a small-model version of GRAFT and tested what makes this isolation work, where hacking concentrates across layers, and the effect of adapter width. In order to conclude that these results are general, we’d need to run larger models in different settings. W
Frequently Asked Questions
What is Gradient Routing Creates a Headstart?
Gradient Routing Creates a Headstart is a article discovery curated from LessWrong. Tl;dr GRAFT showed that we can make reward hacking removable. In the setup we study, a small LLM has two trainable adapters, each consisting of an additional MLP in every layer…
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →The Brilliant Find That Convinced Me to Quit Plastic Storage Containers Forever Is 50% Off
Plus, 5 more early Black Friday deals too good to miss. READ MORE...
Potatoes Savoyard
It’s just as delicious as regular scalloped potatoes. READ MORE...
See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream]
The day’s finally arrived for horror gamers, as the 2026 edition of The Horror Game Awards airs today at 2PM EST / 7PM GMT from 26 Leake Street in London, England. If you missed last month’s reveal of the nominees, Tarsier Studios’ REANIMAL leads the pack with 10 nominations, which includes Game of the Year. […] The post See Who Comes Out on Top at The Horror Game Awards 2026 Today [Stream] appeared first on Bloody Disgusting! .
Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer]
Add another game inspired by H.P. Lovecraft to your list, as developer Darktree Game Studio and Ultimate Games S.A. have announced a January 14 release date on Steam for their upcoming first-person survival horror title, Remnants of R’lyeh. You can also check out the demo now on Steam. The year is 1926, and deep sea […] The post Lovecraftian Survival Horror Game ‘Remnants of R’lyeh’ Launches January 14 [Trailer] appeared first on Bloody Disgusting! .
‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror
As more and more mainstream, big budget horror games seem to shift towards an action-focused mindset, we’ve seen the indie space pick up the mantle of classic survival horror. While many of them draw their inspiration from titans of the genre like Silent Hill or Resident Evil, we rarely see games that try to mimic […] The post ‘Echograph’ Preview: ‘Fatal Frame’-Inspired Low-Poly Game Nails Classic Survival Horror appeared first on Bloody Disgusting! .