Fun toy result: a subliminal-learning effect via on-policy distillation
Kaynak: LessWrong ·
In the standard subliminal learning setup, a teacher model with a preference generates data according to its policy, and then the student is trained on those data. I wondered if it was necessary for the teacher model to actually get to control the produced tokens, so I instead let a no-prompt "teacher" model produce the sequences to be trained on. Then I trained the student against a subliminal-learning-prompted teacher model's logits on those sequences. (Since an unmodified "teacher" is identical to the student model, this is equivalent to just doing on-policy distillation from the prompted t
Sıkça Sorulan Sorular
Fun toy result: a subliminal-learning effect via on-policy distillation nedir?
Fun toy result: a subliminal-learning effect via on-policy distillation, Makale kategorisinde yer alan ve LessWrong üzerinden sunulan bir keşiftir. In the standard subliminal learning setup, a teacher model with a preference generates data according to its policy, and then the student is trained on those data. I wondered if it
Nasıl erişebilir veya deneyimleyebilirim?
Bu içeriğe "Aslına Git" butonuna tıklayarak doğrudan orijinal platformunda (LessWrong) erişebilirsiniz.
Bu içerik nereden geliyor?
Bu içerik LessWrong üzerinden OnSuggest topluluğu ve küratörleri tarafından internetin kaliteli köşelerinden seçilmiştir.
Benzer keşifler
Tüm Kültür ve fikir keşifleri →A Knight Of The Seven Kingdoms Officially Returns December 16
A Knight of the Seven Kingdoms is officially back on December 16th thanks to a brand-new collection featuring George R.R. Martin's beloved characters.
8 Episodes Of Netflix’s Greatest Sci-Fi Hit Deliver Peak Lovecraftian Horror
One of Netflix’s greatest sci-fi hits of all time delivers peak Lovecraftian cosmic horror in the first 8 episodes of its long 42-episode runtime.
Stardew Valley: Timberline Falls Adds Whole New Region To Explore
Stardew Valley: Timberline Falls adds a whole new region to the game, including brand-new NPCs, quests, special orders, and so much more.
Michael B. Jordan's Fantasy Series On Prime Video Reinvents The Genre, And Some Fans Won't Like It
Sinners star Michael B. Jordan might be behind Prime Video’s lavish dragon rider epic, but the fantasy show could sink thanks to one huge risk.
The Lord Of The Rings Officially Unveils A Very Different Aragorn
The Lord of the Rings' newest Aragorn look is something completely unexpected and different, reimagining the iconic Viggo Mortenson role.
Stranger Things Cast Reunites For One Last Laugh In Surprising New Release
Netflix celebrates Stranger Things Day with a surprising new release, reuniting the hit science fiction series' cast on screen one more time.