The J-lens intermediate swap acts partly through the answer directions
Source: LessWrong ·
TL;DR When a language model answers a multi-hop prompt, does it first compute the intermediate concept internally, or does it jump straight to the answer through some shortcut? The global workspace paper investigates this question using the Jacobian lens, which maps activations at a given layer to the tokens that they are poised to verbalize, with the activations possessing a coordinate in each token’s lens direction. The authors intervene on the model through an intermediate swap that exchanges the activation’s J-Lens coordinates for the intermediate and a counterfactual intermediate. They sh
Frequently Asked Questions
What is The J-lens intermediate swap acts partly through the answer directions?
The J-lens intermediate swap acts partly through the answer directions is a article discovery curated from LessWrong. TL;DR When a language model answers a multi-hop prompt, does it first compute the intermediate concept internally, or does it jump straight to the answer through some shortcut? The
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →‘It: Welcome to Derry’ – “A Story of Derry” Finally Reveals Stephen King’s Hero in a Half Shell [The Losers’ Club Podcast]
What’s this? What’s this? Another season of It: Welcome to Derry on HBO Max? Not so. It’s a bonus episode on a bonus episode, a sweet Halloween treat, called “A Story of Derry” that gives us a deeper look into the origins of Pennywise and a cameo by our favorite Ninja Turtle. Join The Losers’ […] The post ‘It: Welcome to Derry’ – “A Story of Derry” Finally Reveals Stephen King’s Hero in a Half Shell [The Losers’ Club Podcast] appeared first on Bloody Disgusting! .
Patrick Stewart's '90s Fantasy Movie With Neve Campbell Is Streaming For Free
Neve Campbell starred opposite Patrick Stewart (as a ghost) in this '90s Oscar Wilde fantasy story adaptation, which you can currently stream for free.
Patrick Dempsey's Thanksgiving Horror Movie Is Worth Revisiting This Holiday Season
If you want to watch a Thanksgiving movie that features amusingly gross deaths, Patrick Dempsey, and more, this Eli Roth horror flick should do the trick.
Deadpool 2's Rob Delaney Debunks Popular X-Men Fan Theory About His Character Peter
Rob Delaney, who plays Peter in the Deadpool film franchise, has thrown cold water on a popular fan theory about the true identity of the character he plays.
Steve Buscemi And Sam Rockwell Have VERY Different Takes On Getting Killed On-Screen
They've died their fair share of times.
One Of The Best Stephen King Adaptations Is Back On Netflix, And I Can't Wait To Watch It Again
It’s definitely my favorite.