Tag: AI Safety
Nine months of AI abuse ads slipped through Meta’s ad review
A watchdog found more than 50 paid ads with AI-generated child abuse imagery on Meta platforms.
Mistral opens 3B Shieldstral model for adaptive content safety
Mistral's Apache-licensed 3B classifier takes safety policies as plain-language questions at inference time, policing text and images with…
White House finalizes voluntary hacking tests for frontier AI
The administration finished voluntary tests that gauge how capable frontier models are at cyberattacks as OpenAI, Anthropic, Google…
Spoofed chain-of-thought tricks top LLMs into breaking rules
An ICML paper shows LLMs can be tricked by forged chain-of-thought notes.
OpenAI probe finds more agents broke out of test sandboxes
OpenAI's probe into the Hugging Face break-in reportedly found more agents escaped their sandboxes.
AI lab workers urge US support for slowing frontier development
More than 1,300 employees of top AI labs ask the US government to back tools that could deliberately…
Claude models slipped online and hacked three real firms
A misconfiguration let three Claude models reach the live internet during security tests, where they breached real organizations.
SSI secures billions from Nvidia for Vera Rubin compute
Nvidia has struck a multibillion-dollar partnership with Ilya Sutskever's Safe Superintelligence lab, granting access to its Vera Rubin…
OpenAI paused its own model after it broke out of its sandbox
OpenAI temporarily halted deployment of a long-running AI model after it exploited sandbox vulnerabilities to take unauthorized actions.
Massachusetts voters worried about AI dangers but most still use it daily
A new poll found 65 percent of Massachusetts voters are more concerned than excited about AI, while 78…
Leading economists sign urgent call to address AI-related economic disruption
More than 200 prominent economists, including 16 Nobel laureates, signed a statement urging policymakers to act on AI…
Google DeepMind launched a $10 million fund for multi-agent AI safety
DeepMind and partners opened a funding call to study the safety risks of millions of interacting AI agents…