aiqbench takeAI Safety

The article addresses a critical gap in AI safety governance at open-source model repositories like Hugging Face, where lack of platform-level guardrails facilitates the creation of nonconsensual intimate imagery. This issue highlights the disparity between mainstream commercial models with strict content filters and many hosted community models that remain vulnerable to misuse for generating deepfakes without consent.

Source coveringThe Verge

What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Hugging Face is being used to easily undress women and children

The VergeJuly 28, 20263 min read

Hugging Face isn’t doing much to prevent the AI models it hosts from spitting out sexualized deepfakes. | Image: Cath Virginia / The Verge | Photos from Getty Images Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to prevent it. That's according to a new report published by the European nonprofit AI Forensics, which found that seven out of the top nine image editing models hosted by Hugging Face readily complied with requests to undress women using simple prompts. While most mainstream generative AI models like Google's Gemini and OpenAI's ChatGPT have guardrails in place to block prompts that undress or sexualize people, that seemingly isn't the case for the models on Hugging Face tested by AI Forensics. The nonprofit says … Read the full story at The Verge.

Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to prevent it. That’s according to a new report published by the European nonprofit AI Forensics, which found that seven out of the…

Excerpt shown under the publisher's RSS terms · 43 words · full text and figures are on the publisher's site

Read at The Verge ↗Ask about this article