Fun toy result: a subliminal-learning effect via on-policy distillation
来源: LessWrong ·
In the standard subliminal learning setup, a teacher model with a preference generates data according to its policy, and then the student is trained on those data. I wondered if it was necessary for the teacher model to actually get to control the produced tokens, so I instead let a no-prompt "teacher" model produce the sequences to be trained on. Then I trained the student against a subliminal-learning-prompted teacher model's logits on those sequences. (Since an unmodified "teacher" is identical to the student model, this is equivalent to just doing on-policy distillation from the prompted t
常见问题
什么是 Fun toy result: a subliminal-learning effect via on-policy distillation？
Fun toy result: a subliminal-learning effect via on-policy distillation is a 文章 discovery curated from LessWrong. In the standard subliminal learning setup, a teacher model with a preference generates data according to its policy, and then the student is trained on those data. I wondered if it
如何访问或体验此内容？
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
此内容来源于哪里？
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
相关发现
所有 文化与思想 发现 →A Knight Of The Seven Kingdoms Officially Returns December 16
A Knight of the Seven Kingdoms is officially back on December 16th thanks to a brand-new collection featuring George R.R. Martin's beloved characters.
8 Episodes Of Netflix’s Greatest Sci-Fi Hit Deliver Peak Lovecraftian Horror
One of Netflix’s greatest sci-fi hits of all time delivers peak Lovecraftian cosmic horror in the first 8 episodes of its long 42-episode runtime.
Stardew Valley: Timberline Falls Adds Whole New Region To Explore
Stardew Valley: Timberline Falls adds a whole new region to the game, including brand-new NPCs, quests, special orders, and so much more.
Michael B. Jordan's Fantasy Series On Prime Video Reinvents The Genre, And Some Fans Won't Like It
Sinners star Michael B. Jordan might be behind Prime Video’s lavish dragon rider epic, but the fantasy show could sink thanks to one huge risk.
The Lord Of The Rings Officially Unveils A Very Different Aragorn
The Lord of the Rings' newest Aragorn look is something completely unexpected and different, reimagining the iconic Viggo Mortenson role.
Stranger Things Cast Reunites For One Last Laugh In Surprising New Release
Netflix celebrates Stranger Things Day with a surprising new release, reuniting the hit science fiction series' cast on screen one more time.