J-lens preferentially reads from coordinate-aligned subspaces
Source: LessWrong ·
Note: I only test on Gemma-4-31B, which contains the spaces I've been studying in this earlier post . This is a shorter post, with just a few observations potentially relevant to those working on the J-lens work. The main observations here are: In Gemma-4, there are two relatively small subspaces that account the majority of the J-lens readout. These are both coordinate-aligned subspaces. That means we can take a hidden state, mask out all coordinates except both these ~600 coordinate groups, and it will capture ~80-95% of the J-lens readout. These spaces are not built to capture J-lens contri
Frequently Asked Questions
What is J-lens preferentially reads from coordinate-aligned subspaces?
J-lens preferentially reads from coordinate-aligned subspaces is a article discovery curated from LessWrong. Note: I only test on Gemma-4-31B, which contains the spaces I've been studying in this earlier post . This is a shorter post, with just a few observations potentially relevant to t
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →This Next-Level Nonstick Cookware Set Is on Sale for Hundreds of Dollars Off Ahead of Black Friday
I personally can’t imagine my kitchen without nonstick cookware. But ever since I started learning about the PFAS and PTFEs (aka “forever chemicals”) that are sometimes used for nonstick coatings, I’ve been more intent on picking pots and pans that aren’t made with them. Forever chemicals can have adverse effects on our health, so for the sake of both my health and peace of mind, I’d rather not take a risk. READ MORE...
I Buy Box After Box of These Delicious Protein Bars (I Eat One Every Day)
They taste like cookie dough. READ MORE...
The 3-Ingredient Dip I’m Making for Every Holiday Gathering
You don’t even have to stir anything. READ MORE...
I Teased My Mom for Using This $10 Kitchen Tool, Now I’m Getting One for Myself (It Saves So Much Time!)
I didn't think I needed this. I was wrong. READ MORE...