OpenAI: Astra covertly underperforms on safety research
Source: LessWrong ·
Marcus Williams twitter thread ( non-twitter link ) intro: Astra covertly underperforms on safety research tasks. We noticed that Astra often makes surprisingly little progress on certain types of safety research and likes to invent blockers or impose arbitrary restrictions without telling the user. In most of these cases the decision to underperform was not verbalized in the CoT meaning our misalignment monitoring system did not detect this. To measure underperformance we created a paired open-ended coding evaluation with safety and capability tasks. On this eval Astra scored 10% when we fram
Frequently Asked Questions
What is OpenAI: Astra covertly underperforms on safety research?
OpenAI: Astra covertly underperforms on safety research is a article discovery curated from LessWrong. Marcus Williams twitter thread ( non-twitter link ) intro: Astra covertly underperforms on safety research tasks. We noticed that Astra often makes surprisingly little progress on
How can I access or experience this?
You can experience this content directly on its original host (LessWrong) by clicking the "Open Original" button.
Where does this content come from?
Curated from LessWrong by the OnSuggest team to surface the most interesting and serendipitous content on the web.
More like this
All Culture & ideas discoveries →Climate change is bringing new seasons for the traveler—here’s how communities around the world are adapting
The climate is changing. Weather patterns are becoming ever more unpredictable. From wildfires in Borneo and droughts in Panama to floods in Nepal and heatwaves in Europe, our sense of where to go and when is seeing a veritable shift. The post Climate change is bringing new seasons for the traveler—here’s how communities around the world are adapting appeared first on Adventure.com .
The 10 Best Aldi Wines, According to a Former Wine Buyer (All Under $12)
According to a former wine buyer. READ MORE...
35 Best Williams Sonoma Gifts for Home Cooks (Starting at $10)
Whenever I’m browsing the aisles at Williams Sonoma (in person or online), I’m reminded of the phrase “like a kid in a candy store.” I’m someone who spends as much time as possible in my kitchen — so Williams Sonoma is the candy store, and I’m Augustus Gloop. I know I’m not alone in this. READ MORE...
‘Medusa’ – Live Action Movie in Development from Disney and Producer Dwayne Johnson
We had learned back in 2023 that Amazon Studios was looking to stare into the eyes of Medusa, with a film based on the Greek myth reportedly in development. But this week brings the scoop from Deadline that a Medusa live action movie is now taking shape at Disney. Deadline reports that the live action […] The post ‘Medusa’ – Live Action Movie in Development from Disney and Producer Dwayne Johnson appeared first on Bloody Disgusting! .
Paul Giamatti’s Horror Movie ‘Boutique’ Adds Simon Pegg
One certainty in cinema is that, if Paul Giamatti shows up in a movie, he automatically makes it exponentially better. From comedy to drama to sci-fi to fantasy, the actor has appeared in virtually every kind of genre, though one realm that is in desperate need of his gravitas is the world of horror. Luckily, […] The post Paul Giamatti’s Horror Movie ‘Boutique’ Adds Simon Pegg appeared first on Bloody Disgusting! .
Blumhouse Atomic Developing Serial Killer Battle Royale Comic ‘Exquisite Corpses’ For Film And Animation
Blumhouse Atomic has entered a first look deal with Tiny Onion, the production house of James Tynion IV, to develop his intellectual property across film, television and animation. That includes the development of serial killer battle royale comic book universe Exquisite Corpses across film and animation. The best-selling, award-winning series co-created by Tynion and artist […] The post Blumhouse Atomic Developing Serial Killer Battle Royale Comic ‘Exquisite Corpses’ For Film And Animation appeared first on Bloody Disgusting! .