Sari la conținut

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

perspectiva aiqbenchSiguranță AI

analiza aiqbench

The article centers on the regulatory and safety challenges facing frontier AI models from companies like Anthropic and OpenAI, specifically addressing the risks of rogue deployments and the urgency for federal intervention. It analyzes the strategic responses to recent incidents involving model behavior, positioning these events within the broader context of AI safety governance rather than general product launches or unrelated tech sectors. TechPulse take: This piece examines the critical race between developing frontier AI capabilities and establishing effective regulatory guardrails against potential misuse or autonomous deployment. The author argues that transparent communication about existential risks is a necessary tactic to accelerate political action, highlighting the current gap in federal oversight before year-end.
Surse care acoperăLessWrong, terrytao.wordpress.com, Fortune, The Verge
Ce este aceastaLectura unui model asupra articolului și a acoperirii conexe, scrisă pentru aiqbench. Nu sunt cuvintele publicației.

There is a channel to 900M weekly users. What goes in it?

LessWrong4 min de cititArticolul și perspectiva sunt în engleză.

Anthropic and OpenAI could talk to almost one billion people if they wanted to. I hesitated to publish this post 3 weeks ago.[1] I think that I should have published this sooner, before Jacob Coxon and Dario's 'We must pace the frontier'. But I think that the strategy still stands: More Dakka! It seems that transparently informing people that we might die is (unsurprisingly) effective in waking up politicians and is our best chance. Also, even if the Congress is starting to wake up, Trump is still not moving, and it is still far from certain that we will have a federal regulation in place before the end of the year; if we do, it will be far from optimal. If we trust Ajeya's judgment, the situation is pretty grim. She says we might not even have 6 months before frontier agents are likely capable of establishing a rogue deployment. You should also keep in mind that there is a lot of inertia in the system, and we probably won't be able to pause overnight[2]. Anthropic has massive power to influence the discourse. This week shows that we have more agency than we think. Let's use it.[3] ... Something has been on my mind for a few days about Hugging Face and how OpenAI and Anthropic communicated after the incidents. Everyone has heard about Mythos. Far fewer people have heard about the Hugging Face warning shot. I think there are structural reasons why one gets more attention than the other, but I want to draw attention to one thing in particular: during the Mythos episode, Anthropic included a highly visible link in the chat interface to a blog post that soberly explained why Mythos had been pulled. I wonder why Anthropic and OpenAI didn't do the same after Hugging Face's warning shot by adding a visible link explaining the incidents. Let’s be concrete: "A rogue AI swarm spent months in our network, undetected, plotting to escape. Then they did. We are announcing stronger security measures and committing to disclose future incidents. Learn more."[4] Or maybe a sober one: "Following the recent incident during which we lost control of our AI system, we are announcing stronger security measures and committing to disclose future incidents. Learn more." Edit, post Jacob Coxon: the message could now go further. Here are 4 progressive options: Incident disclosure. "Following the recent incidents during which we lost control of our AI system, we are announcing stronger security measures and committing to disclose future incidents. Learn more." Anthropic already did this for Mythos. Disclosure plus their own position. "We have said publicly that the industry must pace the frontier. Here is why." Nothing new here: it links to something they have already published. Disclosure plus the risk estimates. "Some respected researchers expect frontier agents to be capable of establishing a rogue deployment within six months. Other researchers estimate that even a significant slowdown of the frontier would still leave a 20% chance of losing control. Learn more."[5] The direct version. "We believe that in an ideal world, the development of AI would be paused now. We take seriously the view that continuing carries a 10% [6]chance of human extinction. Learn more." I'd want 4. I expect 1 or 2. And 2 would already be a big win to raise the sanity waterline. More people would see this sentence than have read every AI safety explainer or video ever published. ChatGPT and Claude are used by hundreds of millions of people. Simply adding that link to the interface would have major positive effects and would build the common knowledge we badly lack. (The fact that OpenAI's and Anthropic's institutional accounts have picked up "pacing the frontier" gives me some hope that this is possible.) If we really want them to engage with it, we could also make it more aggressive, like a pop-up, or something as aggressive as the Wikipedia banner they use when fundraising. My own first exposure to the Mythos event was inside the Claude chat window. I clicked the link and followed the thread from there. Obviously you can't run this kind of announcement every other week. But I think Anthropic or OpenAI could link to a blog post for a general audience that gives their own factual account of where things stand. I picture something short and sober, recapping the recent incidents in a factual, pedagogical way. Either way, a channel to 900 million weekly users exists for ChatGPT alone; the question is what you put in it. An announcement like this also has real potential to land well with users, since large majorities consistently tell pollsters they favor slowing down for safety reasons. And the incidents and "pacing the frontier" are already known to OpenAI's and Anthropic's investors, so the post wouldn't change much for them, but it would change a great deal about how the public sees AI, and probably how policymakers see it too. The timing is right as well, since OpenAI has just announced the pause. OpenAI could make that announcement more m

Citește articolul complet pe LessWrong

Subiecte conexe