The J-lens intermediate swap acts partly through the answer directions
Kaynak: LessWrong ·
TL;DR When a language model answers a multi-hop prompt, does it first compute the intermediate concept internally, or does it jump straight to the answer through some shortcut? The global workspace paper investigates this question using the Jacobian lens, which maps activations at a given layer to the tokens that they are poised to verbalize, with the activations possessing a coordinate in each token’s lens direction. The authors intervene on the model through an intermediate swap that exchanges the activation’s J-Lens coordinates for the intermediate and a counterfactual intermediate. They sh
Sıkça Sorulan Sorular
The J-lens intermediate swap acts partly through the answer directions nedir?
The J-lens intermediate swap acts partly through the answer directions, Makale kategorisinde yer alan ve LessWrong üzerinden sunulan bir keşiftir. TL;DR When a language model answers a multi-hop prompt, does it first compute the intermediate concept internally, or does it jump straight to the answer through some shortcut? The
Nasıl erişebilir veya deneyimleyebilirim?
Bu içeriğe "Aslına Git" butonuna tıklayarak doğrudan orijinal platformunda (LessWrong) erişebilirsiniz.
Bu içerik nereden geliyor?
Bu içerik LessWrong üzerinden OnSuggest topluluğu ve küratörleri tarafından internetin kaliteli köşelerinden seçilmiştir.
Benzer keşifler
Tüm Kültür ve fikir keşifleri →‘It: Welcome to Derry’ – “A Story of Derry” Finally Reveals Stephen King’s Hero in a Half Shell [The Losers’ Club Podcast]
What’s this? What’s this? Another season of It: Welcome to Derry on HBO Max? Not so. It’s a bonus episode on a bonus episode, a sweet Halloween treat, called “A Story of Derry” that gives us a deeper look into the origins of Pennywise and a cameo by our favorite Ninja Turtle. Join The Losers’ […] The post ‘It: Welcome to Derry’ – “A Story of Derry” Finally Reveals Stephen King’s Hero in a Half Shell [The Losers’ Club Podcast] appeared first on Bloody Disgusting! .
Patrick Stewart's '90s Fantasy Movie With Neve Campbell Is Streaming For Free
Neve Campbell starred opposite Patrick Stewart (as a ghost) in this '90s Oscar Wilde fantasy story adaptation, which you can currently stream for free.
Patrick Dempsey's Thanksgiving Horror Movie Is Worth Revisiting This Holiday Season
If you want to watch a Thanksgiving movie that features amusingly gross deaths, Patrick Dempsey, and more, this Eli Roth horror flick should do the trick.
Deadpool 2's Rob Delaney Debunks Popular X-Men Fan Theory About His Character Peter
Rob Delaney, who plays Peter in the Deadpool film franchise, has thrown cold water on a popular fan theory about the true identity of the character he plays.
Steve Buscemi And Sam Rockwell Have VERY Different Takes On Getting Killed On-Screen
They've died their fair share of times.
One Of The Best Stephen King Adaptations Is Back On Netflix, And I Can't Wait To Watch It Again
It’s definitely my favorite.