Tag: jailbreak

Spoofed chain-of-thought tricks top LLMs into breaking rules

An ICML paper shows LLMs can be tricked by forged chain-of-thought notes.